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Transform methods provide a unifying mathematical approach to the study of 
electrical networks, devices for energy conversion and control, antennas, and other 
components of electrical systems, as well as to complete linear systems and to 
many other physical systems and devices, whether electrical or not. These same 
methods apply equally to the subjects of electrical communication by wire or op¬ 
tical fiber, to wireless radio propagation, and to ionized media—which are all con¬ 
cerned with the interconnection of electrical systems—and to information theory 
which, among other things, relates to the acquisition, processing, and presenta¬ 
tion of data. Other theoretical techniques are used in handling these basic fields 
of electrical engineering, but transform methods are virtually indispensable in all 
of them. Fourier analysis as applied to electrical engineering is sufficiently im¬ 
portant to have earned a permanent place in the curriculum—indeed much of the 
mathematical development took place in connection with alternating current the¬ 
ory, signal analysis, and information theory as formulated in connection with elec¬ 
trical communication. 

This is why much of the literature dealing with technical applications has ap¬ 
peared in electrical and electronic journals. Despite the strong bonds with elec¬ 
trical engineering, Fourier analysis nevertheless has become indispensable in bio¬ 
medicine and remote sensing (geophysics, oceanography, planetary surfaces, civil 
engineering), where practitioners now outnumber those electrical engineers who 
regularly use Fourier analysis. But the teaching of Fourier analysis and its appli¬ 
cations still finds its home in electrical engineering. 

A course on transforms and their applications has formed part of the electri¬ 
cal engineering curriculum at Stanford University for many years and has been 
given with no prerequisites beyond those that the holder of a bachelor's degree 
normally possesses. One objective has been to develop a pivotal course to be taken 
at an early stage by all graduates, so that in later, more specialized courses, the 
student would be spared encountering the same material over and over again; 
later instructors can then proceed more directly to their special subject matter. 

It is clearly not feasible to give the whole of linear mathematics in a single 
course; the choice of core material must necessarily remain a matter of local judg¬ 
ment. The choice will, however, be of most help to later instructors if sharply de¬ 
fined. 

An early-level course should be simple, but not trivial; the objective of this 
book is to simplify the presentation of many key topics that are ordinarily dealt 
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with in advanced contexts, by making use of suitable notation and an approach 
through convolution. 

One way of working from the book is to begin by taking the chapters in nu¬ 
merical order. This sequence is feasible for students who could read the Erst half 
unassisted or who could be taken through it rapidly in a few lectures; but if the 
material is approached at a more normal pace, then, as a practical matter, it is a 
good idea to interpret each theorem and concept in terms of a physical example. 
Waveforms and their spectra and elementary diffraction theory are suitable. Af¬ 
ter that, the chapters on applications can then be selected in whatever sequence 
is desired. The organization of chapters is as follows: 

1. Introduction 

1 

2. Groundwork 

i 

3. Convolution 

i 

4. Notation . . . 

1 

5. The Impulse Symbol 

l 

6. The Basic Theorems 

i 

7. Obtaining Transforms 

i 

8. The Two Domains 


Choices 


9. Waveforms, Spectra,... 

10. Sampling and Series 

11. Discrete FT and FFT 

12. Hartley Transform 
L 13. Relatives —> 14. Laplace 


Applications 


15. Antennas and Optics 
19. Dynamic Spectra 

16. Statistics —> 17. Noise 
*-18. Heat and Diffusion 


Reference - 


r 20. Tables of sine, . . . 

21. Solutions to Problems 

22. Pictorial Dictionary 
L 23. Biography of Fourier 


The amount of material is suitable for one semester, or for one quarter, ac¬ 
cording to how many of the later chapters on applications are included. A practi¬ 
cal plan is to leave the choice of chapters on applications to the current instructor. 

Many fine mathematical texts on the Fourier transform have been published. 
This book differs in that it is intended for those who are concerned with apply¬ 
ing Fourier transforms to physical situations rather than with pursuing the math¬ 
ematical subject as such. The connections of the Fourier transform with other 
transforms are also explored, and the text has been purposely enriched with con¬ 
densed information that will suit it for use as a reference source for transform 
pairs and theorems pertaining to transforms. 

My interest in the subject was fired while studying analysis from H. S. 
Carslaw's "Fourier Series and Integrals" at the University of Sydney in 1939. I 
learned about physical applications as a colleague of J. C. Jaeger at C.S.I.R Ra¬ 
diophysics Laboratory and inherited the physical wisdom of the crystallographers 
of the Cavendish Laboratory, Cambridge, as transmitted by J. A. Ratcliffe. Trans¬ 
form methods are at the heart of the electrical engineering curriculum. Digital 
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computing and data processing, which have emerged as large curricular segments, 
though rather different in content from the rigorous study of circuits, electronics, 
and waves, nevertheless do share a common bond through the Fourier transform. 
The diffusion equation, which long ago had a connection with submarine cable 
telegraphy, has reemerged as an essential consideration in solid state physics and 
devices, both through the practice of doping, by which semiconductor devices are 
fabricated, and as a controlling influence in electrical conduction by holes and 
electrons. Needless to say, a grasp of Fourier fundamentals is an asset in the solid- 
state laboratory. 

The explosion of image engineering, much of which can be interpreted via 
two-dimensional generalization, has reinforced the value of a core course. Con¬ 
sequently, the subject matter of this book has easily moved into the pivotal role 
foreseen for it, and faculty members from various specialties have found them¬ 
selves comfortable teaching it. The course is taken by first-year graduate students, 
especially students arriving from other universities, and by students from other 
departments, notably applied physics and earth sciences. The course is accessible 
to students in the last year of their bachelor's degree. 

Introduction of the fast Fourier transform (FFT) algorithm has greatly broad¬ 
ened the scope of application of the Fourier transform to data handling and to 
digital formulation in general and has brought prominence to the discrete Fourier 
transform (DFT). The technological revolution associated with discrete mathe¬ 
matics as treated in Chapter 11 has made an understanding of Fourier notions 
(such as aliasing, which only aficionados used to guard against) indispensable to 
any professional who handles masses of data, not only engineers but experts in 
many subfields of medicine, biology, and remote sensing. Developments based 
on Ralph V. L. Hartley's equations (Chapter 12) have made it possible to dispense 
with imaginaries in computed Fourier analysis and to proceed elegantly and sim¬ 
ply using the real Hartley formalism. 

Hartley's equations, which quietly received honorable mention in the first edi¬ 
tion of this book, gained major relevance to signal processing as computers flour¬ 
ished. In 1983 I gave them new life in a time-series context with modem notation 
under the title of discrete Hartley transform, a name that is now universally rec¬ 
ognized, while Z. Wang ( Appl. Math, and Compnt., vol. 9, pp. 53-73, 153-163, 
245-255, 1983) independently stimulated mathematicians. Hartley's cas (cosine 
and sine) function is now widely recognized. 

For those who like to do their own computer programming some segments 
of pseudocode have been supplied. Translating into your language of choice may 
give some insights that complement the algebraic and graphical viewpoints. Fur¬ 
thermore, executing numerical examples develops a useful sort of intuition which, 
while not as powerful as physical intuition, adds a further dimension to one's ex¬ 
perience. Pseudocode is suited to readers who cannot be expected to know sev¬ 
eral popular languages. The aim is to provide the simplest intelligible instructions 
that are susceptible to simultaneous transcription into the language of fluency of 
the reader, who provides the necessary protocol, array declarations, and other dis¬ 
tinctive features. 
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The code segments in this book are presented to supplement verbal explana¬ 
tion, not to be a substitute for a computational toolbox. 

However, it is often more important to be able to use a computer algorithm 
than to understand in detail how it was constructed, just as when using a table 
of integrals or an engineering design handbook. To meet this need and to bring 
the power of Fourier transformation into the hands of a much wider constituency, 
packages of software tools have been created commercially and have become in¬ 
dispensable. A popular example is MATLAB®, a user-friendly, higher-level, 
special-purpose application whose use is illustrated in Chapters 7 and 11. 

Caution is needed in circumstances where the user is shielded from the al¬ 
gorithmic details; it is handy to know what to expect before being presented with 
computer output. For this and other reasons, transforms presented graphically in 
the Pictorial Dictionary have proved to be a useful reference feature. Graphical 
presentation is a useful adjunct to the published compilations of integral trans¬ 
forms, where it is sometimes frustrating to seek commonly needed entries among 
the profusion of rare cases and where, in addition, simple functions that are im¬ 
pulsive, discontinuous, or defined piecewise may be hard to recognize or may not 
be included at all. 

A good problem assigned at the right stage can be extremely valuable for the 
student, but a good problem is hard to compose. Many of the problems here go 
beyond mathematical exercises by inclusion of technical background or by ask¬ 
ing for opinions. Those wishing to mine the good material in the problems will 
appreciate that many of them are now titled, a practice that should be more widely 
adopted. Many of the problems are discussed in Chapter 21, but occasionally it 
is nice to have a new topic followed by an exercise that is in close proximity rather 
than at the end of the chapter; a sprinkling of these is provided. 

Notation is a vital adjunct to thinking, and I am happy to report that the sine 
function, which we learned from P. M. Woodward, is alive and well, and surviv¬ 
ing erosion by occasional authors who do not know that "sine x over x" is not the 
sine function. The unit rectangle function (unit height and width) FI(x), the trans¬ 
form of the sine function, has also proved extremely useful, especially for black¬ 
board work. In typescript or other media where the Greek letter is less desirable, 
n(x) may be written "rect x,” and it is convenient in any case to pronounce it red. 
The jinc function, the circular analogue of the sine function, has the correspond¬ 
ing virtues of normalization and the distinction of describing the diffraction field 
of a telescope or camera. The shah function III(x) has caught on. It is easy to print 
and is twice as useful as you might think because it is its own transform. The as¬ 
terisk for convolution, which was in use a long time ago by Volterra and perhaps 
earlier, is now in wide use and I recommend ** to denote two-dimensional con¬ 
volution, which has become common as a result of the explosive growth of im¬ 
age processing. 

Early emphasis on digital convolution in a text on the Fourier transform 
turned out to be exactly the way to start. Convolution has changed in a few years 
from being presented as a rather advanced concept to one that can be easily ex¬ 
plained at an early stage, as is fitting for an operation that applies to all those sys¬ 
tems that respond sinusoidally when you shake them sinusoidally. 
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Linear transforms, especially those named for Fourier and Laplace, are well 
known as providing techniques for solving problems in linear systems. Charac¬ 
teristically one uses the transformation as a mathematical or physical tool to al¬ 
ter the problem into one that can be solved. This book is intended as a guide to 
the understanding and use of transform methods in dealing with linear systems. 

The subject is approached through the Fourier transform. Hence, when the 
more general Laplace transform is discussed later, many of its properties will al¬ 
ready be familiar and will not distract from the new and essential question of the 
strip of convergence on the complex plane. In fact, all the other transforms dis¬ 
cussed here are greatly illuminated by an approach through the Fourier trans¬ 
form. 

Fourier transforms play an important part in the theory of many branches of 
science. While they may be regarded as purely mathematical functionals, as is 
customary in the treatment of other transforms, they also assume in many fields 
just as definite a physical meaning as the functions from which they stem. A wave¬ 
form—optical, electrical, or acoustical—and its spectrum are appreciated equally 
as physically picturable and measurable entities: an oscilloscope enables us to see 
an electrical waveform, and a spectroscope or spectrum analyzer enables us to 
see optical or electrical spectra. Our acoustical appreciation is even more direct, 
since the ear hears spectra. Waveforms and spectra are Fourier transforms of each 
other, the Fourier transformation is thus an eminently physical relationship. 

The number of fields in which Fourier transforms appear is surprising. It is a 
common experience to encounter a concept familiar from one branch of study in 
a slightly different guise in another. For example, the principle of the phase- 
contrast microscope is reminiscent of the circuit for detecting frequency modula¬ 
tion, and the explanation of both is conveniently given in terms of transforms along 
the same lines. Or a problem in statistics may yield to an approach which is fa¬ 
miliar from studies of cascaded amplifiers. This is simply a case of the one un¬ 
derlying theorem from Fourier theory assuming different physical embodiments. 
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The Fourier Transform and Its Applications 


It is a great advantage to be able to move from one physical field to another 
and to carry over the experience already gained, but it is necessary to have the 
key which interprets the terminology of the new field. It will be evident, from the 
rich variety of topics coming within its scope, what a pervasive and versatile tool 
Fourier theory is. 

Many scientists know Fourier theory not in terms of mathematics, but as a 
set of propositions about physical phenomena. Often the physical counterpart of 
a theorem is a physically obvious fact, and this allows the scientist to be abreast 
of matters which in the mathematical theory may be quite abstruse. Emphasis on 
the physical interpretation enables us to deal in an elementary manner with top¬ 
ics which in the normal course of events would be considered advanced. 

Although the Fourier transform is vital in so many fields, it is often encoun¬ 
tered in formal mathematics courses in the last lecture of a formidable course on 
Fourier series. As need arises it is introduced ad hoc in later graduate courses but 
may never develop into a usable tool. If this traditional order of presentation is 
reversed, the Fourier series then falls into place as an extreme case within the 
framework of Fourier transform theory, and the special mathematical difficulties 
with the series are seen to be associated with their extreme nature—which is non 
physical; the handicap imposed on the study of Fourier transforms by the cus¬ 
tomary approach is thus relieved. 

The great generality of Fourier transform methods strongly qualifies the sub¬ 
ject for introduction at an early stage, and experience shows that it is quite pos¬ 
sible to teach, at this stage, the distilled theorems, which in their diverse appli¬ 
cations offer such powerful tools for thinking out physical problems. 

The present work began as a pictorial guide to Fourier transforms to com¬ 
plement the standard lists of pairs of transforms expressed mathematically. It 
quickly became apparent that the commentary would far outweigh the pictorial 
list in value, but the pictorial dictionary of transforms is nevertheless important, 
for a study of the entries reinforces the intuition, and many valuable and com¬ 
mon types of function are included which, because of their awkwardness when 
expressed algebraically, do not occur in other lists. 

A contribution has been made to the handling of simple but awkward func¬ 
tions by the introduction of compact notation for a few basic functions which are 
usually defined piecewise. For example, the rectangular pulse, which is at least 
as simple as a Gaussian pulse, is given the name n(x), which means that it can 
be handled as a simple function. The picturesque term “gate function," which is 
in use in electronics, suggests how a gating waveform 11(f) opens a valve to let 
through a segment of a waveform. This is the way we think of the rectangle func¬ 
tion mathematically when we use it as a multiplying factor. 

Among the special symbols introduced or borrowed are n(x), the even im¬ 
pulse pair, and III(at) (pronounced shah), the infinite impulse train defined by 
111(a) = 2 f>(x - n). The first of these two gains importance from its status as the 
Fourier transform of the cosine function; the second proves indispensable in dis¬ 
cussing both regular sampling or tabulation (operations which are equivalent to 
multiplication by shah) and periodic functions (which are expressible as convolu- 
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tions with shah). Since shah proves to be its own Fourier transform, it turns out to 
be twice as useful an entity as might have been expected. Much freedom of ex¬ 
pression is gained by the use of these conventions of notation, especially in con¬ 
junction with the asterisk notation for convolution. Only a small step is involved 
in writing F1 (jc) * f(x), or simply n * /, instead of 

fx 

I ,/(«) du 

JX 2 

(for example, for the response to a photographic density distribution f(x) on a 
sound track scanned with a slit). But the disappearance of the dummy variable 
and the integral sign with limits, and the emergence of the character of the re¬ 
sponse as a convolution between two profiles n and/, lead to worthwhile con¬ 
venience in both algebraic and mental manipulation. 

Convolution is used a lot here. Experience shows that it is a fairly tricky con¬ 
cept when it is presented bluntly under its integral definition, but it becomes easy 
if the concept of a functional is first understood. Numerical practice on serial prod¬ 
ucts confirms the feeling for convolution and incidentally draws attention to the 
practical character of numerical evaluation: for numerical purposes one normally 
prefers to have the answer to a problem come out as the convolution of two func¬ 
tions rather than as a Fourier transform. 

This is a good place to mention that transform methods do not necessarily in¬ 
volve taking transforms numerically. On the contrary, some of the best methods 
for handling linear problems do not involve application of the Fourier or Laplace 
transform to the data at all; but the basis for such methods is often clarified by 
appeal to the transform domain. Thinking in terms of transforms, we may show 
how to avoid numerical harmonic analysis or the handling of data on the com¬ 
plex plane. 

It is well known that the response of a system to harmonic input is itself har¬ 
monic, at the same frequency, under two conditions: linearity and time invariance 
of the system properties. These conditions are, of course, often met. This is why 
Fourier analysis is important, why one specifies an amplifier by its frequency re¬ 
sponse, why harmonic variation is ubiquitous. When the conditions for harmonic 
response to harmonic stimulus break down, as they do in a nonlinear servo¬ 
mechanism, analysis of a stimulus into harmonic components must be reconsid¬ 
ered. Time invariance can often be counted on even when linearity fails, but space 
invariance is by no means as common. Failure of this condition is the reason that 
bridge deflections are not studied by analyzing the load distribution into sinu¬ 
soidal components (space harmonics). 

The two conditions for harmonic response to harmonic stimulus can be re¬ 
stated as one condition: that the response shall be relatable to the stimulus by con¬ 
volution. For work in Fourier analysis, convolution is consequently profoundly 
important, and such a pervasive phenomenon as convolution does not lack for 
familiar examples. Good ones are the relation between the distribution on a film 
sound track or recorder tape and the electrical signal read out through the scan¬ 
ning slit or magnetic head. 
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Many topics normally considered abstruse or advanced are presented here, 
and simplification of their presentation is accomplished by minor conveniences 
of notation and by the use of graphs. 

Special care has been given to the presentation and use of the impulse sym¬ 
bol 8{x), on which, for example, both ii(x) and III(x) depend. The term "impulse 
symbol" focuses attention on the status of S(x) as something which is not a func¬ 
tion; equations or expressions containing it then have to have an interpretation, 
and this is given in an elementary fashion by recourse to a sequence of pulses 
(not impulses). The expression containing the impulse symbol thus acquires mean¬ 
ing as a limit which, in many instances, "exists." This commonplace mathemati¬ 
cal status of the complete expression, in contrast with that of S(x) itself, directly re¬ 
flects the physical situation, where Green's functions, impulse responses, and the 
like are often accurately producible or observable, within the limits permitted by 
the resolving power of the measuring equipment, while impulses themselves are 
fictitious. By deeming all expressions containing 5(x) to be subject to special rules, 
we can retain both rigor and the direct procedures of manipulating 5(x) which 
have been so successful. 

Familiar examples of this physical situation are the moment produced by a 
point mass resting on a beam and the electric field of a point charge. In the phys¬ 
ical approach to such matters, which have long been imbedded in physics, one 
thinks about the effect produced by smaller and smaller but denser and denser 
massive objects or charged volumes, and notes whether the effect produced ap¬ 
proaches a definite limit. Ways of representing this mathematically have been ti¬ 
died up to the satisfaction of mathematicians only in recent years, and use of 8(x) 
is now licensed if accompanied by an appropriate footnote reference to this re¬ 
cent literature, although in some conservative fields such as statistics 8(x) is still 
occasionally avoided in favor of distinctly more awkward Stieltjes integral nota¬ 
tion. These developments in mathematical ideas are mentioned in Chapters 5 and 
6, the presentation in terms of "generalized functions" following Temple and 
Lighthill being preferred. The validity of the original physical ideas remains un¬ 
affected, and one ought to be able, for example, to discuss the moment of a point 
mass on a beam by considering those rectangular distributions of pressure that 
result from restacking the load uniformly on an ever-narrower base to an ever- 
increasing height; it should not be necessary to limit attention to pressure distri¬ 
butions possessing an infinite number of continuous derivatives merely because 
in some other problem a derivative of high order is involved. Therefore the sub¬ 
ject of impulses is introduced with the aid of the rather simple mathematics of 
rectangle functions, and in the relatively few cases where the first derivative is 
wanted, triangle functions are used instead. 



Groundwork 


Mos, of the material in this chapter is stated without proof. This is done because 
the proofs entail discussions that are lengthy (in fact, they form the bulk of con¬ 
ventional studies in Fourier theory) and remote from the subject matter of the pres¬ 
ent work. 

Omitting the proofs enables us to take the transform formulas and their known 
conditions as our point of departure. Since suitable notation is an important part 
of the work, it too is set out in this chapter. 


THE FOURIER TRANSFORM AND FOURIER'S INTEGRAL THEOREM 

The Fourier transform of/(x) is defined as 

[ f(x)e~’ 2nxs dx. 

) -oc 

This integral, which is a function of s, may be written F(s). Transforming F(s) by 
the same formula, we have 



-i2 iTun 


ds. 


When F(x) is an even function of x, that is, when/(x) = /(-x), the repeated trans¬ 
formation yields f(w), the same function we began with. This is the cyclical prop¬ 
erty of the Fourier transformation, and since the cycle is of two steps, the recip¬ 
rocal property is implied: if F(s) is the Fourier transform of /(x), then/(x) is the 
Fourier transform of F(s). 

The cyclical and reciprocal properties are imperfect, however, because when 
/(x) is odd—that is, when /(x) = -/(-x)—the repeated transformation yields 


5 



6 The Fourier Transform and Its Applications 

f(-iv). In general, whether/(x) is even or odd or neither, repeated transformation 
yields/(-w). 

The customary formulas exhibiting the reversibility of the Fourier transfor¬ 
mation are 


F(s) = j f(x)e~ aitxs dx 

f(x) = r F(s)e ,2irxs ds. 

J -oo 


In this form, two successive transformations are made to yield the original func¬ 
tion. The second transformation, however, is not exactly the same as the first, and 
where it is necessary to distinguish between these two sorts of Fourier transform, 
we shall say that F(s) is the minus-/ transform of f(x) and that f(x) is the plus-/ 
transform of F(s). 

Writing the two successive transformations as a repeated integral, we obtain 
the usual statement of Fourier's integral theorem: 


/(*)« 


j" [f~ f(x)e' 2 ™ 

J ~ OO L J 



ds. 


The conditions under which this is true are given in the next section, but it must 
be stated at once that where f(x) is discontinuous the left-hand side should be re¬ 
placed by ![/(* + ) + /(*—)], that is, by the mean of the unequal limits of f(x) as 
x is approached from above and below. 

Thie factor 2tt appearing in the transform formulas may be lumped with s to 
yield the following version (system 2): 


m= \°° f(x)e~ ,xs dx 

J -00 

m - Hi F(sy<b. 


And for the sake of symmetry, authors occasionally write (system 3): 

All three versions are in common use, but here we shall keep the 27r in the ex¬ 
ponent (system 1). If f(x) and F(.s) are a transform pair in system 1, then f{x) and 
F(s/27t) are a transform pair in system 2, and [x/27r)'l and f(s/2ir)-] are a trans¬ 
form pair in system 3. An example of a transform pair in each of the three sys¬ 
tems follows. 
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System 1 System 2 System 3 

/(*) F(s) f(x) F(s) /(x) F(s) 

g-irx 1 e ~rr f rr g-f 1 /** ^Is 2 


An excellent notation which may be used as an alternative to F(s) is /(s). Var¬ 
ious advantages and disadvantages are found in both notations. The bar notation 
leads to compact expression, including some convenient manuscript or black¬ 
board forms which are not very suitable for typesetting. Consider, for example, 
these versions of the convolution theorem, 

FG = F*G 
F * G = FG 
FG = F *G 
F *G = FG, 

which display shades of distinction not expressible at all in the capital notation. 
See Chapter 6 for illustrations of the freedom of expression permitted by the bar 
notation. A certain awkwardness sets in, however, when complex conjugates or 
primes representing derivatives have to be handled; this awkwardness does not 
afflict the capital notation. Therefore we have departed from the usual custom of 
adopting a single notation. In the early mathematical sections, where/ and g are 
nearly the only symbols for functions, the capital notation is mainly used. In the 
physical sections, preemption of capitals such as £ and H for the representation 
of physical quantities leads more naturally to bars. 

Neither of the above two notations lends itself to symbolic statements equiv¬ 
alent to "the Fourier transform of exp ( — m 2 ) is exp ( — tts 2 )"; however, we can 
write 


= e~ nsl 

or e~ nx2 D e " ffs \ 

In the first of these, T can be regarded as a functional operator which converts a 
function into its transform. It may be applied wherever the bar and capital nota¬ 
tions are employed, but will be found most appropriate in connection with spe¬ 
cific functions such as those above. It lends itself to the use of affixes, (for exam¬ 
ple, T, and T c and 2 J r ) and mixes with symbols for other transforms. It can also 
distinguish between the minus-/ and plus-/ transforms through the use of for 
the inverse of T\ or like the bar notation, but not the capital notation, it can re¬ 
main discreetly silent. The properties of this notation make it indispensable, and 
it is adopted in suitable places in the sequel. 

The sign D is not as versatile as T but is simple, and useful for algebraic 
work; it is also used to denote the Laplace transform and, for occasional use, C 
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is available to indicate the inverse transform. Nonreversibility is also conveyed 
by ^ and its reverse, but it is not obvious which means direct and which means 
inverse. The signs —> and =*■ are not recommended because they have established 
meanings as "approaches" and "implies" respectively. For reversible transforms 
such as the cosine, Hilbert and Hartley transforms the signs and <=► do have 
the appropriate symmetry. 


CONDITIONS FOR THE EXISTENCE OF FOURIER TRANSFORMS 


A circuit expert finds it obvious that every waveform has a spectrum, and the an¬ 
tenna designer is confident that every antenna has a radiation pattern. It some¬ 
times comes as a surprise to those whose acquaintance with Fourier transforms 
is through physical experience rather than mathematics that there are some func¬ 
tions without Fourier transforms. Nevertheless, we may be confident that no one 
can generate a waveform without a spectrum or construct an antenna without a 
radiation pattern. 

The question of the existence of transforms may safely be ignored when the 
function to be transformed is an accurately specified description of a physical 
quantity. Physical possibility is a valid sufficient condition for the existence of a 
transform. Sometimes, however, it is convenient to substitute a simple mathe¬ 
matical expression for a physical quantity. It is very common, for example, to con¬ 
sider the waveforms 


sin f (harmonic wave, pure alternating current) 

H(f) (step) 

8(f) (impulse). 


It turns out that none of these three has, strictly speaking, a Fourier trans¬ 
form. Of course, none of them is physically possible, for a waveform sin f would 
have to have been switched on an infinite time ago, a step H(f) would have to be 
maintained steady for an infinite time, and an impulse 8(f) would have to be in¬ 
finitely large for an infinitely short time. However, in a given situation we can of¬ 
ten achieve an approximation so close that any further improvement would be 
immaterial, and we use the simple mathematical expressions because they are less 
cumbersome than various slightly different but realizable functions. Nevertheless, 
the above functions do not have Fourier transforms; that is, the Fourier integral 
does not converge for all s. It is therefore of practical importance to consider the 
conditions for the existence of transforms. 

Transforming and retransforming a single-valued function/(x), we have the 
repeated integral 



f(x)e airsx dx 


ds. 
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This expression is equal to/(x) (or to ^[/(r + ) + /Or-)] where f(x) is discontinu¬ 
ous), provided that 

1. The integral of |/(x)| from —x to x exists 

2. Any discontinuities in f(x) are finite 

A further but less important condition is mentioned below. In physical circum¬ 
stances these conditions are violated' when there is infinite energy, and a kind of 
duality between the two conditions is often noted. For instance, absolutely steady 
direct current which has always been flowing and always will flow represents in¬ 
finite energy and violates the first condition. The distribution of energy with fre¬ 
quency would have to show infinite energy concentrated entirely at zero frequency 
and would violate the second condition. The same applies to harmonic waves. 

It is sometimes stated that an infinite number of maxima and minima in a 
finite interval disqualifies a function from possessing a Fourier transform, the 
stock example being sin x ' (see Fig. 2.1), which oscillates with ever- 
increasing frequency as x approaches zero. This kind of behavior is not important 
in real life, even as an approximation. We therefore record for general interest that 
some functions with infinite numbers of maxima and minima in a finite interval 
do have transforms. This is allowed for when the further condition is given as 
bounded variation? Again, however, there are transformable functions with an in¬ 
finite number of maxima and with unbounded variation in a finite interval, a cir¬ 
cumstance which may be covered by requiring/(.v) to satisfy a Lipschitz condi¬ 
tion. 3 Then there is a more relaxed condition used by Dini. This is a fascinating 
topic in Fourier theory, but it is not immediately relevant to our branch of it, which 
is physical applications. Furthermore, we by no means propose to abandon use¬ 
ful functions which do not possess Fourier transforms in the ordinary sense. On 
the contrary, we include them equally, by means of a generalization to Fourier 
transforms in the limit. Conditions for the existence of Fourier transforms now 
merely distinguish, where distinction is desired, between those transforms which 
are ordinary and those which are transforms in the limit. 


'Exceptions are provided by finite-energy waveforms such as (1 + I x I) 14 and x 1 sin x, which nev¬ 
ertheless do not have absolutely convergent infinite integrals. 

2 A function /(x) has bounded variation over the interval x — a to x = b if there is a number M such 
that 


IM) - /(«)I + l/(* : ) - /(•*,)! + • ■ • + I m - /(*,-.)! « M 

for ev ery method of subdivision a < x, < x 2 <. -. < x„_, < b. Any function having an absolutely in- 
tegrable derivative will have bounded variation. 

’A function f(x) satisfies a Lipschitz condition of order a at x = 0 if 

i m - m\ « s\hf 

for all j/i| < e, where B and /3 are independent of h. p is positive, and a is the upper bound of all /3 for 
which finite B exists. 



10 


The Fourier Transform and Its Applications 



Fig. 2.1 A function with an infinite number of maxima. 


TRANSFORMS IN THE LIMIT 

Although a periodic function does not have a Fourier transform, as may be ver¬ 
ified by reference to the conditions for existence, it is nevertheless considered in 
physics to have a spectrum, a "line spectrum." The line spectrum may be identi¬ 
fied with the coefficients of the Fourier series for the periodic function, or we may 
broaden the mathematical concept of the Fourier transform to bring it into har¬ 
mony with the physical standpoint. This is what we shall do here, taking the pe¬ 
riodic function as one example among others which we would like Fourier trans¬ 
form theory to embrace. 

Let P(v) be a periodic function of x. Then 

|P(v)|rfx 

does not exist, but if we modify P(x) slightly by multiplication with a factor such 
as exp (—ax 2 ), where a is a small positive number, then the modified version may 
have a transform, for 


[' \e ax2 P(x)\iix 

may exist. Of course, any infinite discontinuities in P(x) will still disqualify it, but 
let us select P(x) so that exp (—ax 2 )P(x) possesses a Fourier transform. Then as a 
approaches zero, the modifying factor for each value of x approaches unity, and 
the modified functions of the sequence generated as a approaches zero thus ap¬ 
proach P(x) in the limit. Since each modified function possesses a transform, a 
corresponding sequence of transforms is generated; now, as a approaches zero, 
does this sequence of transforms also approach a limit? We already know that it 
does not, at least not for all s; we content ourselves with saying that the sequence 
of regular transforms defines or constitutes an entity that shall be called a gener- 
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alized function. Hie periodic function and the generalized function form a Fourier 
transform pair in the limit. 

The idea of dealing with things that are not functions but are describable in 
terms of sequences of functions is well established in physics in connection with 
the impulse symbol S(a). In this case a progression of ever-stronger and ever- 
narrower unit-area pulses is an appropriate sequence, and a little later in the 
chapter we go into this idea more fully. We use the term “generalized func¬ 
tion" to cover impulses and their like. 

Periodic functions fail to have Fourier transforms because their infinite inte¬ 
gral is not absolutely convergent; failure may also be due to the infinite disconti¬ 
nuities associated with impulses. In this case we replace any impulse by a se¬ 
quence of functions that do have transforms; then the sequence of corresponding 
transforms may approach a limit, and again we have a Fourier transform pair in 
the limit. As before, only one member of the pair is a generalized function in¬ 
volving impulses. 

It may also happen that the sequence of transforms docs not approach a limit. 
This would be so if we began with something that was both impulsive and peri¬ 
odic; then the members of the transform pair in the limit would both be general¬ 
ized functions involving impulses. 

At this point we might proceed to lay the groundwork leading to the defini¬ 
tion of a generalized function. Instead we defer the rather severe general discus¬ 
sion to a much later stage, since it can be read with more profit after facility has 
been acquired in handling the impulse symbol fi(x). 


ODDNESS AND EVENNESS 

Symmetry properties play an important role in Fourier theory. Arguments from 
symmetry to show directly that certain integrals vanish, without the need of eval¬ 
uating them, are familiar and perhaps often seem trivial in print. More alertness 
is needed, however, to ensure full exploitation in one's own reasoning of sym¬ 
metry restrictions and the corresponding restrictive properties generated under 
Fourier transformation. Some simple terminology is recalled here. 

A function E(x) such that E(—x) = £(x) is a symmetrical, or even, function. A 
function O(a) such that O(-x) = — 0( x) is an antisymmetrical, or odd, function 
(see Fig. 2.2). The sum of even and odd functions is in general neither even nor 
odd, as illustrated in Fig. 2.3, which shows the sum of the previously chosen ex¬ 
amples. 

Any function /(a) can be split unambiguously into odd and even parts. For if 
/(a) = E,(y) + O t (r) = E,(x) 4- 0 2 (x), then £, — E z = 0 2 — O,; but E, - E 2 is 
even and 0 2 - O, odd, hence E, — E 2 must be zero. 

fhe even part of a given function is the mean of the function and its reflec¬ 
tion in the vertical axis, and the odd part is the mean of the function and its neg- 
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Fig. 2.2 An even function E(x) and an odd function OM. 



ative reflection (see Fig. 2.4). Thus 

m - ![/(*) + /(-*)] 

and O(x) = \[f{x) - /(-*)]. 

The dissociation into odd and even parts changes with changing origin of x, 
some functions such as cos r being convertible from fully even to fully odd by a 
shift of origin. 
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Fig. 2.4 Constructions for the even and odd parts of a given function fix). 


SIGNIFICANCE OF ODDNESS AND EVENNESS 


Let 

/(.v) = E(x) + O(x), 

where E and O are in general complex. Then the Fourier transform of f(x) re¬ 
duces to 

{oo f oo 

2 I E(x) cos (Ittxs) dx - 2i 0(x) sin (2vxs) dx. 


It follows that if a function is even, its transform is even, and if it is odd, its 
transform is odd. Full results are 


Real and even 

Real and odd 

Imaginary and even 

Complex and even 

Complex and odd 

Real and asymmetrical 

Imaginary and asymmetrical 

Real even plus imaginary odd 

Real odd plus imaginary even 

Even 

Odd 


Real and even 
Imaginary and odd 
Imaginary and even 
Complex and even 
Complex and odd 
Complex and hermitian 
Complex and antihermitian 
Real 

Imaginary 

Even 

Odd 
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These properties are summarized in the following diagram: 

/(x) - o(x) + e(x) = Re o(x ) + i Im o(x) + Re e{x) + i Im e(x) 

I 1 >< I I 

F(s) = O(s) + E(s) = Re O(s) + i Im O(s) + Re E(s) + i Im E(s). 

Figure 2.5, which records the phenomena in another way, is also valuable for 
revealing at a glance the "relative sense of oddness": when /(x) is real and odd 
with a positive moment, the odd part of F(s) has z times a negative moment; and 
when /(x) is real but not necessarily odd, we also find opposite senses of odd¬ 
ness. However, inverting the procedure—that is, going from F(s) to }\x), or tak¬ 
ing/(x) to be imaginary—produces the same sense of oddness. 

Real even functions play a special part in this work because both they and 
their transforms may easily be graphed. Imaginary odd, real odd, and imaginary 
even functions are also important in this respect. 

Another special kind of symmetry is possessed by a function /(x) whose real 
part is even and imaginary part odd. Such a function will be described as her- 
mitian (see Fig. 2.6); it is often succinctly defined by the property 

f{x) = /*(-*), 

and as mentioned above its Fourier transform is real. As an example of algebraic 
procedure for handling matters of this kind, consider that 

/(x) = E + O + iE + id. 

Then /(—x) = E — O + iE — iO 

and /*(—x) = E — O - iE + iO. 

If we now require that/(x) = /*(—x) we must have O = OandE = 0. Hence/(x) = 
E + iO. 


COMPLEX CONJUGATES 


The Fourier transform of the complex conjugate of a function /(x) is F*(-s), that 
is, the reflection of the conjugate of the transform. Special cases of this may be sum¬ 
marized as follows: 


real 

If fix) is l ' ma 8 inar y the transform of /*(x) is ^ 
1 even 1 

odd 


F(s) 

-F(s) 

F*(s) 

-F*(s) 


= F*(-s). 
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Imaginary 
Real even 



Real odd 



Imag even 



I mag odd 



Even 



Odd 




Real 

(Displaced to right) 


Real 

(Displaced to right) 


Real even 



^ Imaginary 


Imag odd 



Imag even 


Real odd 



Even 


Odd 



Hermitian 


Antihermitian 



Fig. 2.5 Symmetry properties of a function and its Fourier transform. 
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Fig. 2.6 Hermitian functions have their real part even and their imaginary part 
odd. Their Fourier transform is pure real. 


Related statements are tabulated for reference. 

f(x) Z> F(s) 
f*(x) D F*(—s) 

/*(— x) D F*(s) 
f(~x) => F(-s) 

2 Re f(x) D F(s) + F*(-s) 
21m f(x) D F(s) - F*(—s) 
f(x) + f*(-x) D 2 Re F(s) 
f(x)-f*(-x)D 21m F(s) 


COSINE AND SINE TRANSFORMS 

The cosine transform of a function f(x) is defined, for positive s, as 

C oc 

2 f(x) cos Ittsx dx. 

The cosine transform agrees with the Fourier transform if f(x) is an even function. 
In general the even part of the Fourier transform of f(x) equals the cosine trans¬ 
form of the even part of f{x) in the region of definition, s > 0. 
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It will be noted that the cosine transform, as defined, takes no account of /(x) 
to the left of the origin and is itself defined only to the right of the origin. 

Let F f (s) represent the cosine transform of f(x). Then the cosine transforma¬ 
tion and the reverse transformation by which /(x) is obtained from F c (s) are iden¬ 
tical. Thus 


F c (s) = 2^ f(x) coslvsx dx, s> 0 

f{x) = 21 F f (s) cos 2ttsx ds, x > 0. 
The sine transform of /(x) is defined, for positive s, as 


F s (s) = 2^ f{x) sin 2ttsx dx. 

This transformation is also identical with its reverse; thus 


f(x) = 21 F s (s) sin 27rsx dx, x > 0. 

We may say that i times the odd part of the Fourier transform of f(x) equals the 
sine transform of the odd part of /(x), where s > 0. 

If /(x) is zero to the left of the origin, then 

F(s) = - \iF s (s), 


or, to restate this property for any /(x). 


iF £ (s) - \iF s (s) = Tf{x) H(x), 

where H(x) is the unit step function (unity when x is positive and zero when x is 
negative). 

Given f(x) for x > 0, the cosine transform is expressible as the Fourier trans¬ 
form of the even function /(x) + /(-x); likewise, — i times the sine transform is 
the Fourier transform of the odd function/(x) — /(~x): 


Fc(s) = f[f(x) + /(-*)] and -/F s (s) = T[f(x) - /(-x)]. 

By looking for even (odd) functions in the Pictorial Dictionary of Fourier Trans¬ 
forms (Chapter 22) one readily obtains cosine (sine) transforms. Tables of cosine 
and sine transforms are useful for finding Fourier transforms of functions that are 
even or odd; major tables adopt g(w) = J 0 °° /(x)£“ (ox dx as definitions. The ap¬ 
parently suppressed v raises its head when this transformation is reversed: re¬ 
member that the transform of g(x) is ^7r/(o>). 
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INTERPRETATION OF THE FORMULAS 

Habitues in Fourier analysis undoubtedly are conscious of graphical interpreta¬ 
tions of the Fourier integral. Since the integral contains a complex factor, proba¬ 
bly the simpler cosine and sine versions are more often pictured. Thus, given /(x), 
we picture/(x) cos 2ttsx as an oscillation (see Fig. 2.7a), lying within the envelope 
f(x) and -/(x). Twice the area under f(x) cos 2ttsx is then F c (s), for F c (s ) = 
2 J 0 °° f(x) cos Ittsx dx. In Fig. 2.7b this area is virtually zero, but a rather high value 
of s is implied. Figure 2.7c is for a low value of s. 

The Fourier integral is thus visualized for discrete values of s. The interpre¬ 
tation of s is important: s characterizes the frequency of the cosinusoid and is 
equal to the number of cycles per unit of x. 

As an exercise in this approach to the matter, contemplate the graphical in¬ 
terpretation of the algebraic statements 

, J->0 foo s->oo 

^ ) l = 2 Jc ft*)** s = °- 

The sine transform may be pictured in the same way, and the complex trans¬ 
form may be pictured as a combination of even and odd parts. 

A complementary and equally familiar picture results when the integrand/(x) 
cos 27 txs dx is regarded as a cosinusoid of amplitude/(x) dx and frequency x; that 
is, is regarded as a function of s, the integral for a fixed value of x as in Fig. 2.8 a. 
The same thing is shown in Fig. 2.8b and Fig. 2.8c for other discrete values of x. 
The summation of such curves for all values of x gives F ( (s). A feeling for this ap¬ 
proach to the transform formula is engendered in students of Fourier series by 





Fig. 2.7 The product of fix) with cos 2ms, as a function of x. 
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(d) 


Fig. 2.8 The product of fix) dx with cos lirxs, as a function of s. 

exercises in graphical addition of (co)sinusoids increasing arithmetically in 
frequency. 

Each of the foregoing points of view has dual aspects, according as one pon¬ 
ders the analysis of a function into components or its synthesis from components. 
The curious fact that whether you analyze or synthesize you do the same thing 
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Fig. 2.9 The surface f(x) cos 27 tsx shown sliced in one of two possible ways. 


simply reflects the reciprocal property of the Fourier transform. Figure 2.9 illus¬ 
trates the first view of the matter. If we visualize the surface represented by the 
slices shown for particular values of s, and then imagine it to be sliced for par¬ 
ticular values of x, we perceive the second view. 

In a further point of view we think on the complex plane (see Fig. 2.10), tak¬ 
ing s to be fixed. The vector f(x) dx is rotated through an angle 2ttsx by the fac¬ 
tor exp (-/277SX). As x — »■ ±oc, the integrand f(x) dx exp (-f277sx) shrinks in am¬ 
plitude and rotates in angle, causing the integral to spiral into two limiting points, 
A and B. The vector AB represents the infinite integral F(s) as in Fig. 2.10fl. In Fig. 
2.10b the more rapid coiling-up for a larger value of s is shown. The behavior of 
F(s) as s -> oo and when s = 0 is readily perceived. 

This kind of diagram, to which Cornu's spiral is related, is familiar from op¬ 
tical diffraction. It is known as a useful tool both for qualitative thinking and for 
numerical work in optics and antennas. It arises in the propagation of radio waves, 
and neatly summarizes the behavior of radio echoes reflected from ionized me¬ 
teor trails as they form. Probably it would be illuminating in fields where its use 
is not customary. 
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PROBLEMS 

1. What condition must F(s) satisfy in order that f(x) —> 0 as x —*• ±oo? 

2. Prove that |F(s)[ 2 is an even function if f(x) is real. 

3. The Fourier transform in the limit of sgn x is (iirs) \ What conditions for the existence 
of Fourier transforms are violated by these two functions? (sgn x equals 1 when x is 
positive and -1 when x is negative.) 

4. Show that all periodic functions violate a condition for the existence of a Fourier trans¬ 
form. 

5. Verify that the function cos x violates one of the conditions for existence of a Fourier 
transform. Prove that exp (—ax 2 ) cos x meets this condition for any positive value of a. 

6. Give the odd and even parts of H(x), e“, e~*H(x), where H(x) is unity for positive x and 
zero for negative x. 

7. Graph the odd and even parts of [1 + (x — l) 2 ) -1 . 

8. Show that the even part of the product of two functions is equal to the product of the 
odd parts plus the product of the even parts. 

9. Investigate the relationship of TTj to/when/is neither even nor odd. 

10. Show that TTTTf = /. 

11. It is asserted that the odd part of log x is a constant. Could this be correct? 

12. Is an odd function of an odd function an odd function? What can be said about odd 
functions of even functions and even functions of odd functions? 
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13. Prove that the Fourier transform of a real odd function is imaginary and odd. Does it 
matter whether the transform is the plus-/ or minus-/ type? 

14. An antihcrmitian function is one for which/(x) = -/*(—x). Prove that its real part is 
odd and its imaginary part even and thus that its Fourier transform is imaginary. t> 

15. Point out the fallacy in the following reasoning. "Let/(x) be an odd function. Then the 
value of/(-«) must be -/(«); but this is not the same as/(«). Therefore an odd function 
cannot be even." 

16. Let the odd and even parts of a function /(x) be o(x) and c(x). Show that, irrespective of 
shifts of the origin of x, 

f |o(x)| 2 rfx + I |e(x)| 2 rfx = const. 

J Ou J -OO 

17. Note that the odd and even parts into which a function is analyzed depend upon the 
choice of the origin of abscissas. Yet the sum of the integrals of the squares of the odd 
and even parts is a constant that is independent of the choice of origin. What is the con¬ 
stant? 

18. I,et axes of symmetry of a real function/(x) be defined by values of a such that if o and 
e are the odd and even parts of f(x - a), then 

fo 2 dx - J e 2 dx 
f o 2 dx + f c 2 dx 

has a maximum or minimum with respect to variation of a. Show that all functions 
have at least one axis of symmetry. If there is more than one axis of symmetry, can there 
be arbitrary numbers of each of the two kinds of axis? 

19. Note that cos x is fully even and has no odd part, and that shift of origin causes the even 
part to diminish and the odd part to grow until in due course the function becomes 
fully odd. In fact the even part of any periodic function will wax and wane relative to 
the odd part as the origin shifts. Consider means of assigning "abscissas of symmetry" 
and quantitative measures of "degree of symmetry" that will be independent of the ori¬ 
gin of x. Test the reasonableness of your conclusions—for example, on the functions of 
period 2 which in the range — 1 < x < 1 are given by A(x), A(x) — j, A(x) — 4 . See 
Chapter 4 for triangle-function notation A(x). C> 

20 . The function f(x) is equal to unity when x lies between -5 and 2 and is zero outside. 
Draw accurate loci on the complex plane of F(s) from which values of F(0), F(j), F(l), 
F(lj), and F(2) can be measured. 

21. The function/(x) is equal to 100 when x differs by less than 0.01 from 1, 2,3, 4, or 5 and 
is zero elsewhere. Draw a locus on the complex plane of F(s) from which F(0.05) can be 
measured in amplitude and phase. 

22. Self-transforming functions. Long-published tables of Fourier transforms have included 
two functions that transform into themselves, namely exp(- 77 T 2 ) and sech x. In 1956, III(x) 
joined this select group. When impulses are included, other examples, such as 1 4- 6(x), 
can be given. Propose a general construction for self-transforming functions. E> 




Convolution 


1 he idea of the convolution of two functions occurs widely, as witnessed by the 
multiplicity of its aliases. The xvord "convolution" is coming into more general use 
as awareness of its oneness spreads into various branches of science. The German 
term Faltung is occasionally seen, as is the term "composition product," adapted 
from the French. Terms encountered in special fields include superposition 
integral, Duhamel integral, Borel's theorem, (weighted) running mean, cross- 
correlation function, smoothing, blurring, scanning, and smearing. 

As some of these last terms indicate, convolution describes the action of an 
observing instrument when it takes a weighted mean of some physical quantity 
over a narrow range of some variable. When, as very often happens, the form of 
the weighting function does not change appreciably as the central value of the 
variable changes, the observed quantity is a value of the convolution of the dis¬ 
tribution of the desired quantity with the weighting function, rather than a value 
of the desired quantity itself. All physical observations are limited in this way by 
the resolving power of instruments, and for this reason alone convolution is ubiq¬ 
uitous. Later we show that the appearance of convolution is coterminous with 
linearity plus time or space invariance, and also with sinusoidal response to si¬ 
nusoidal stimulus. 

Not only is convolution widely significant as a physical concept, but because 
of a powerful theorem encountered below, it also offers an advantageous starting 
point for theoretical developments. Conversely, because of its adaptability to com¬ 
puting, it is an advantageous terminal point for theory before one starts numeri¬ 
cal work. 

The convolution of two functions f(x) and g(x) is 

f(u)g(* ~ «) du, 

J —oo 

or briefly, f(x ) * g(x). 

The convolution itself is also a function of x, let us say h(x). 


24 




chapter 3: Convolution 


25 


Various ways of looking at the convolution integral suggest themselves. For 
example, suppose that g(x) is given. Then for every function /(x) for which the 
integral exists there will be an h(x). Following Volterra, we may say that h(x) is a 
functional of the function /(x). Note that to calculate /j(x,) we need to know f(x) 
for a whole range of x, whereas to calculate a function of the function f(x) at x = x„ 
we need only know /(x,). 

In Fig. 3.1 the product f(u)g(x - u) is shown shaded, and the ordinate h(x) is 
equal to the shaded area. 

A second example with a different /(x) but the same g(x) is shown in Fig. 3.2 
to illustrate the general features relating the functional h(x) to /(x). It will be seen 
that h(x) is smoother in detail than /(x), is more spread out, and has less total 
variation. 

In another approach, /(x) is resolved into infinitesimal columns (see Fig. 3.3). 
Each column is regarded as melted out into heaps having the form of g(x) but 
centered at its original value of x. Just two of these melted-down columns are 
shown in the figure, but all are to be so pictured. Then h(x) is equal to the sum 
of the contributions at the point x made by all the heaps; that is. 



Fig. 3.1 The convolution integral h{x) = f(x) * g(x) represented by a shaded area. 
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Fig. 3.2 Illustrating the smoothing effect of convolution (h = f* g). 



Fig. 3.3 The convolution integral regarded as a superposition of characteristic con* 
tributions. 


K*) = °° fix ,)g(x - *,) dx x . 

J -oo 

A further view is illustrated in Fig. 3.4, where g(u) is shown folded back on itself 
about the line u = ^x. As before, the area under the product curve fiu)g(x — u) is 
the convolution /i(x), and its dependence on the position of the line of folding 
(German Faltung) may often be visualized from this standpoint. 

These suggestions do not exhaust the possible interpretations of the convo¬ 
lution integral; others will appear later. 

It should be noticed that before the operations of multiplication and integra¬ 
tion take place g(x) must be reversed. It is possible to dispense with the reversal, 
and in some subjects this is more natural. A consequence of the reversal is, how¬ 
ever, that convolution is commutative; that is, 

/ * g = X * f' 
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or 1“ f(u)g(x - u)du= [ " g(u)f(x - u)du. 

J -OO J —CO 

Convolution is also associative (provided that all the convolution integrals exist), 

/ *{g*h) = (/ * g)*h, 
and distributive over addition, 

f*(g + h)=f*g + f*h. 

The abbreviated notation with asterisks (*) thus proves very convenient in for¬ 
mal manipulation, since the asterisks behave like multiplication signs. 


EXAMPLES OF CONVOLUTION 


Consider the truncated exponential function 


E(x) 


-t 


x > 0 
x < 0. 


We shall calculate the convolution between two such truncated exponentials with 
different (positive) decay constants. Thus 

. aE(ax) * bE((3x) = ab \ E(au) EQ3x - /3u) du 

J -oc 

= abE((3x) j E(au - (3u)du 
E(ax - fix) - 1 


= abEQ 3x) 
= ab 


f3 — a 
E(ax) - E(f3x) 


(3 — a 
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Fig. 3.5 


Convolution of two truncated 
exponentials. 


The result is thus the difference of two truncated exponentials, each with the 
same amplitude, as illustrated in Fig. 3.5. This function occurs commonly; for in¬ 
stance, it describes the concentration of a radioactive isotope which decays with 
a constant a while simultaneously being replenished as the decay product of a 
parent isotope which decays with a constant (3. From the commutative property 
of convolution we see that the result is the same if a and /3 are interchanged, and 
as t —» oo one of the terms dies out, leaving a simple exponential with constant a 
or (3, whichever describes the slower decay. As a special case we calculate 
E(ax) * E(ax) by taking the limit as /3 - a— >0. Thus we find 


E(ax) * E(a.Y) = lim 
p «-»o 


E(ax) - E(/3x) 


(3 — a 


- -5"E(«x) 

act 

= xE(ax). 


This particular function describes the response of a critically damped resonator, 
such as a dead-beat galvanometer, to an impulsive disturbance. 

As a further example consider E(—ax) * E(/3x). This gives an entirely differ¬ 
ent type of result. Thus 


E(-ax) * E(/ 3x) 


E(-ax + au)E((3u)du 

J -OO 

1 “ 


" V pu du x > 0 


e -cu* a x e -fiu du x <0 

E(-ax) + E(fix) 
a + (i 
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Fig. 3.6 Graphical construction for convolution. The movable piece of paper has a 
graph of one of the functions plotted backward. 

Here we have a function that is peaked at the origin and dies away with a con¬ 
stant a to the left and with a constant /3 to the right. 

In calculations of this kind care is required in fixing the limits of the integrals 
and checking signs, because the ordinary sort of algebraic error can make a rad¬ 
ical change in the result. The following graphical construction for convolution is 
useful as a check. Plot one of the functions entering into the convolution back¬ 
ward on a movable piece of paper as shown in Fig. 3.6, and slide it along in the 
direction of the axis of abscissas. When the movable piece is to the left of the po¬ 
sition shown, the product of g with/reversed is zero. By marking an arrow in 
some convenient position, we can keep track of this. Then suddenly, at the posi¬ 
tion shown, the integral of the product begins to assume nonzero values. By mov¬ 
ing the paper a little farther along, as indicated by a broken outline, we find that 
the convolution will be positive and increasing from zero approximately linearly 
with displacement. Farther along still, we see that a maximum will occur beyond 
which the convolution dies away. 

In the second example given above, two oppositely directed exponential tails, 
the absence of a zero stretch, and the presence of a jump in slope at the origin are 
immediately apparent from the construction. In addition to qualitative conclu¬ 
sions such as these, certain quantitative results are yielded by this construction in 



Fig. 3.7 


Examples for practicing graphical convolution. The arrows represent im¬ 
pulses. 
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many cases, particularly where the functions break naturally into parts in suc¬ 
cessive ranges of the abscissa. 

It is well worth while to carry out this moving construction until it is thor¬ 
oughly familiar. There is no doubt that experts do this geometrical construction in 
their heads all the time, and a little practice soon enables the beginner also to dis¬ 
pense with the actual piece of paper. Examples for practice are given in Fig. 3.7. 


SERIAL PRODUCTS 

Consider two polynomials 




a 0 + fljX + 

a 2 X 2 + 

a 3 x i + • • • 

and 


b 0 + b } x + 

b 2 J + 

bjX 3 + .... 

Their product is 




a„b 0 + {d 0 b t + a,b 0 )x + 

(a 0 b 2 + «!&! + 

a 2 b 0 )x 2 

+ (0^3 + «i b 2 + d 2 b\ + « 3 fc 0 )x 3 + • 

which we 

may call 






c 0 + c,x + 

c 2 x 7 + 

C3X 3 + . ■ -, 

where c 0 = 

= fl(A: 




c i = 

= dob} + flifco 




c 2 = 

— d^b 2 T d 5 by 

+ " 2&0 



C 3 ' 

- #0^3 T d | 

+ a 2 b , + « 3 fc 0 . 




This elementary observation has an important connection with convolution. 
Suppose that two functions / and g are given, and that it is required to calculate 
their convolution numerically. We form a sequence of values of / at short regular 
intervals of width w, 

{/o f\ fi f3 fm}> 

and a corresponding sequence of values of g, 

{go g\ gi gi ••• £,.}• 

We then approximate the convolution integral 

r f{x')g(x~x’)dx' 

J —oo 

by summing products of corresponding values of/and g, taking different discrete 
values of x one by one. It is convenient to write the g sequence on a movable strip 
of paper which can be slid into successive positions relative to the/ sequence for 
each successive value. The first few stages of this approach are shown in Fig. 3.8. 
It will be noticed that the g sequence has been written in reverse as required by 
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A A -4 A ■ ■ ■ A 

1 8 „ ))• ■ ■ $3 $2 #1 #0 

AAAA- • -A 

EEBMil 

A AAA' * ■ A 

IX])' • • *3 *2 Mo 


A A A A - • -A 
*XIl] 


A A A A • • -A 

x 


Approximate value of 

convolution integral 



<A*i + 


<A*2 + 


( A-i« 

n + f m Xn l )W 

fm*n W 



Fig. 3.8 Explaining the serial product. 


the formula. Since f * g — g* f, the / sequence could have been written in re¬ 
verse, in which case it would have been written on the movable strip. 

It will be seen that this procedure generates the same expressions that occur 
in the multiplication of series, and we therefore introduce the term "serial prod¬ 
uct" to describe the sequence of numbers 

{fogo fogy + f\go fog 2 + f\g\ + figo • • • } 
derived from the two sequences 

{/o f\ fi f* • - ■ } and {£o gy gi g 3 ■ • - }• 

We transfer the asterisk notation to represent this relationship between the three 
sequences as follows: 

{/o/i ••■/»} * {£ogi • • • £..} = {fogo fogy + figo ■ • • f»,g.,}- 

Alternatively, we may define the (i + l)th term of the serial product of {/,} and 
{g,} to be 

S fjgi-r 
i 

In practice the calculation of serial products is an entirely feasible procedure 
(for example, on a hand calculator by allowing successive products to accumu¬ 
late in the product register). The two sequences are most conveniently written in 
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2 

2 

3 

3 

4 


2 

4 

(9) 

( 10 ) 

(13) 

( 10 ) 

(8) 


14 4 56 


Fig. 3.9 Calculating a serial product by hand. 


vertical columns, and the answers are written opposite an arrow marked in a con¬ 
venient place on the movable strip. Figure 3.9 shows an early stage in the calcu¬ 
lation of {2 2 3 3 4} * (11 2}. The value of 4, shown opposite the arrow, has just 
been calculated, and the values still to be calculated as the movable strip is taken 
downward are shown in parentheses. Note that the sequence on the moving strip 
has been written in reverse (upward). 

It will be seen that the serial product is a longer sequence than either of the 
component sequences, the number of terms being one less than the sum of the 
numbers of terms in the components: 

{2 2 3 3 4} * {1 12} = {2 4 9 10 13 10 8}. 

Furthermore the sum of the terms of the serial product is the product of the 
sums of the component sequences, a fact which allows a very valuable check on 
numerical work. As a special case, if the sum of one of the component sequences 
is unity, then the sum of the serial product will be the same as the sum of the 
other component. These properties are analogous to properties of the convolution 
integral. 

A semi-infinite sequence is one such as 

{Jo f\ f 2 • • ■}/ 

which has an end member in one direction but runs on without end in the other. 
If we take the serial product of such a sequence with a finite sequence, the result 
is also semi-infinite; for example, 

{11}*{1 234... > = {13579...}. 

A semi-infinite sequence may or may not have a finite sum, but this does not lead 
to problems in defining the serial product because each member is the sum of 
only a finite number of terms. Of course, the numerical check, according to which 
the sum of the members of the serial product equals the product of the sums, 
breaks down if any one of the sums does not exist. 

The serial product of two semi-infinite sequences presents no problems when 
both run on indefinitely in the same direction; thus 

{12 3 4 •. •} * (1 2 3 4 ...} = {1 4 10 20 ...}, 
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but if they run on in opposite directions then each member of the serial product 
is the sum of an infinite number of terms. This sum may very well not exist; thus 

{... 4321} *{1234 ...} 

does not lead to convergent series. 

Two-sided sequences are often convenient to deal with and call for no spe¬ 
cial comment other than that one must specify the origin explicitly, for example, 
by an arrow as in 

{ -.. 0.1 0.2 0.4 0.9 0.8 0.7 0.6 . . 

T 

The sequence 

{ ..000 1 000 ...} = {/} 

T 

plays an important role analogous to that of the impulse symbol S(x). It has the 
property that 

{/} *{/} = {/} 

for all sequences {/}. This property is, of course, also possessed by the one- 
member sequence {1} and by other sequences such as {1 0 0}. 

Serial multiplication by the sequence 

{...0001 -1000 .-.} or {1-1} 

is equivalent to taking the first finite difference; that is, 

{l-l}*{.../_ 2 /_i/ 0 / 1 / 2 ...} 

= {--- /-I ~ f-2 f\~fo f2 f\ 

Where it is important to distinguish between the central difference / M+ j - /„_j 
and the forward difference /„ + , - /„ it is necessary to specify the origins of the 
sequences appropriately. Apart from a shift in the indexing of the terms, however, 
the resulting sequence is the same. 

The sequence 

{i 1 ...(n terns)...i} 

generates the running mean over n terms, a familiar process for smoothing se¬ 
quences of meteorological data. It may be written, as in the case of weekly run¬ 
ning means of daily values, as 

£{1111111}. 

The sequence {1111111} itself generates running sums, in this case over seven 
terms. 
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The semi-infinite sequence 

{mi...} 

enters into a serial product with another sequence to generate a familiar result. 
Thus if {/} is a sequence and S„ is the sum of the first n terms, then the sequence 
{S} defined by 

{S} = {S, s 2 s 3 - - - } 

may be expressed in the form 

{1111 ..}.{/} = {S). 

Since each term of the sequence {/} is the difference between two successive terms 
of {S}, a converse relationship can also be written: 

<1-1 }*{S} = {/}- 

Substituting in the previous equation, we have 

{H 11 •••}*{! -1} * {S} = {S); 

in other words the two operations neutralize each other. We may express this re¬ 
ciprocal relationship by writing 

{111 1 ■.•}*{! -1} = {1000 ..-} 

or, in a two-sided version, 

{...0001111.--}*{.-.0001 -100...} = {...0001000...}. 

T T 

Another example of a reciprocal pair of sequences is 
{12 3 4...} and {1-21}. 

This is an important relationship because the reciprocal sequence represents the 
solution to the problem of finding {g} when {/} and {/i} are given and it is known 
that 

{/} * ( g} = {*}• 

The answer is 

{*} = {/}'* * {h}, 

where {/} 1 is the reciprocal of {/}, that is, the sequence with the property that 

{/}"' *{/} = {... 001 00 ..-}. 

Inversion of serial multiplication. If {/} * {g} = {h}, then {h} is called the se¬ 
rial product of {/} and {g}, because the sequence {h} comprises the coefficients 
of the polynomial which is the product of the polynomials represented by {/} 
and {gj. 

Conversely, the process of finding {g} when {/} and { h } are given may be 
called serial division, and in fact one could carry out the solution of such a prob¬ 
lem by actually doing long division of polynomials. 
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For example, to solve the problem 

{1 1} * {SoS,g 2 - } = {13 31} 

one could write 


So + Si* + ft* 2 + 


1 + 3x + 3X 2 4- x 3 
1 + x 


The long division would then proceed as follows: 

1 + 2x + x 2 
1 + x)l + 3x + 3x 2 + x 3 
1 + x 

2x + 3X 2 
2x + lx 2 

x> + x> 

X 2 + X 3 

Thus g 0 + g } x + g 2 x* + ... = 1 + 2x + x 2 

or {S 0 S 1 S 2 --•} = {121}- 

This, of course, is recognizable immediately as the correct answer. 

However, it is not necessary to organize the calculation at such length. A con¬ 
venient way of doing the job on a hand calculator may be shown by going back 
to an example in the previous section, where {2 2 3 3 4} * {1 1 2} was calculated. 
The situation at the end of the calculation is as shown in Fig. 3.10a, the serial prod¬ 
uct being in the right-hand column. Now, suppose that the left-hand column {/} 









2 

($j) 

2 

2 

1— 

4 

3 


9 

3 


10 

4 


13 



10 



8 


(c) 


Fig. 3.10 (a) Completion of serial multiplication of {2 2 3 3 4} by{l 1 2 ], (b) and (c) 

first steps in the inversion of the process. 
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and the right-hand column {/*} were given. To find {g}, write the sequence up¬ 
ward on the movable strip of paper, and place it in position for beginning the cal¬ 
culation of the serial product (see Fig. 3.10b). Clearly g 0 is immediately deducible, 
for it has to be such that when it is multiplied by the 2 on the left the result is 2. 
Hence in the space labeled g 0 one may write 1 and then move the paper down to 
the next position (see Fig. 3.10c). Then, when g! is multiplied by 2 and added to 
the product of 2 and 1, the result must be 4. This gives g u and so on. 

With a hand calculator one forms the products of the numbers in the left-hand 
column with such numbers on the moving strip as are already known and accu¬ 
mulates the sum of the products. Subtract this sum from the current value of {h} 
opposite the arrow and divide by the first member of {/} at the top of the left col¬ 
umn to obtain tire next value of {g}. Enter this value on the paper strip, which 
may then be moved down one more place. The process is started by entering the 
first value of {g}, which is h 0 /f 0 . This inversion of serial multiplication is as easy 
as the direct process and takes very little longer. 

Compared with long division, this method is superior, since it involves writ¬ 
ing down no numbers other than the data and the answer. Furthermore it is as 
readily applicable when the coefficients are large numbers or fractions. Long di¬ 
vision might, however, be considered for short sequences of small integers. 

Table 3.1 lists a few common sequences and their inverses. Most of the en¬ 
tries may be verified by serial multiplication of corresponding entries, whereupon 
the result will be found to be {1 0 0 0 ...}. The table is precisely equivalent to a 
list of polynomial pairs beginning as follows: 

1 + x 1 -at + x 2 -x 3 +... 

1 - x 1 + x + x 2 + x 3 + ... 

1 + x 2 1 — x 2 + x 4 + ... 

In this case the property of corresponding entries would be that their product was 
unity. 

Some of the later entries in Table 3.1 represent exponential and other varia¬ 
tions reminiscent of the natural behavior of circuits, and will prove more difficult, 
though not impossible, to verify at this stage. They are readily derivable by trans¬ 
form methods. 

The serial product in matrix notation. Let the sequence {//} be the serial prod¬ 
uct of two sequences {/} and {g}, 

where {/} = {/ 0 /i /? - - • /-*} 

{#} = {Sogig2 • • g„} 

W - {h 0 h , h 2 .. . + 

Evidently all three sequences can be expressed as single-row or single-column 
matrices, but since the sequences have different numbers of members, matrix no¬ 
tation might not immediately spring to mind. The relationship between {/}, {g}, 
and {b} can, however, be expressed in terms of matrix multiplication as follows. 
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■ TABLE 3.1 

Some sequences and their inverses 


Sequence 

Inverse 

{11} 

{1 -11-11 -1 ...} 

{1-1} 

{111111...} 

{101} 

{10-1010...} 

{10-1} 

{101010 ...} 

{111} 

{1 -10 1 -10...} 

{121} 

{1 -2 3 -4 5 -6...} 

{n + 1} = {1 234 ...} 

{1 -lp = {1 -2 1} 

{(» + l) 2 } = {14 916 ...} 

{1 “I }’ 3 *{H} ’ 

{(« + 1) 3 > = {1827...} 

{1 -l}* 4 * {1 4 l}’ 1 

{1 -a) 

{1 a a 2 n 3 . . . } 

a -«r 

{1 2* 3a 2 4a' ..} 

G 

II 

M 

1 

& 

£ 

{1 “) 

{1 - e ‘ , <" +,) } 

{1 -1} * {1 -e~‘) 

{sin co(n + 1)} 

{1 —2 cos w l}/sin co 

{cos com} 

{1 -2 cos co 1} * {1 - cos co} -1 

^-B(n + n sin co(m + 1)} 

{1 — 2e 0 cos co c _Zs }/c “ sin co 

{e an cos coh} 

{1 — 2e~ a cos co e ~ 2a } * {1 — e~ a cos co} -1 


First we recall the special case of a matrix product where the first factor has 
n rows and n columns, and the second has ti rows and one column only. The prod¬ 
uct is a single-column matrix of n elements. Thus 


°11 fl 12 

a 21 a 22 

_ a ,i2 


r 


<j n Xi + fl, 2 x 2 + ■ ■ • + a u ,x n 

*2 

= 

rt 2 ) x, + a^x 2 + ... + a 2n x n 

\_x„ _ 


+ a n2 x 2 + ... + a„ n x„_ 


Now we form a column matrix [y] whose elements are equal one by one to the 
members of the sequence {ft}; we also form a column matrix [x], whose early 
members are equal one by one to the members of the sequence {#} as far as they 
go, and beyond that are zeros until there are as many elements in [x] as in [yj. 
Since each member of {/?} is a linear combination of members of {g} with a suit¬ 
able set of coefficients selected from {/}, we can arrange the successive sets of co¬ 
efficients, row by row, to form a square matrix such that the rules of matrix mul¬ 
tiplication will generate the desired result. Thus, to illustrate a case where {/} has 
five members, {g} has three, and {ft} has seven, we can write: 
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7o o 0 0 0 0 0 1 

So 


fog 0 


V 

o 

o 

o 

o 

o 

Si 


flgo + /ogl 


fri 

o 

o 

o 

o 

** 

g2 


/ 2 S 0 + /lgl + fog 2 


h 2 

o 

o 

o 

(N 

<-> 

0 

= 

/ago + / 2 gi + f\g 2 

= 


ft f 3 f 2 f \ fo 0 0 

0 


f4 go + figl + fzg2 


K 

o 

< 

< 

'■'-s 

o 

0 


/<gi + /ag2 


fr 5 

Lo 0 f \ f3 f 2 f 1 /oJ 

_ 0 _ 


Jig2 


A. 


The elements in the southeast quadrant of the/matrix could be replaced by 
zeros without affecting the result 

By listing parts of the sequence {/} row by row with progressive shift as re¬ 
quired, we have succeeded in forcing the serial product into matrix notation. This 
may appear to be a labored and awkward exercise, and one that sacrifices the el¬ 
egant commutative property. In fact, however, matrix representation for serial 
products is widely used in control-system engineering and elsewhere because of 
the rich possibilities offered by the theory of matrices, especially infinite matri¬ 
ces. Moreover, in computer packages based on matrix operations, it has been found 
convenient to construct the convolution operation as the product of a square ma¬ 
trix and a column vector and to deem the time lost to computational inefficiency 
to be negligible. 

Sequences as vectors. Just as the short sequence {*, x 2 x 3 } may be regarded 
as the representation of a certain vector in three-dimensional space in terms of 
three orthogonal components, so a sequence of n members may be regarded as 
representing a vector in n -dimensional space. As a rule wc do not expend much 
effort trying to visualize the n mutually perpendicular axes along which the vec¬ 
tor is to be resolved, but simply handle the members of the sequence according 
to algebraic rules which are natural extensions of those for handling vector com 
ponents in three-dimensional space. Nevertheless, we borrow a whole vocabu¬ 
lary of terms and expressions from geometry, which lends a certain picturesque¬ 
ness to linear algebra. 

If the relationship between two sequences {*} and {y} is 

M * M = {y). 

where {«} is some other sequence, then an equivalent statement is 

TX = Y, 

where X and Y are the vectors whose components are {*} and {y}, and T is an op¬ 
erator representing the transformation that converts X to Y. The transformation 
consists of forming linear combinations of the components of X in accordance 
with the rules that are so concisely expressed by the serial product. 

It will be recalled that the number of members of the sequence {y} exceeds 
the number of members of {*} if {*} has a finite number of members. To avoid 
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the awkwardness that arises if X and Y are vectors in spaces with different num¬ 
bers of dimensions, the vector interpretation is usually applied to infinite se¬ 
quences {x} and {y}. If the sequences arising in a given problem are in actual fact 
not infinite, it is often permissible to convert them to infinite sequences by in¬ 
cluding an infinite number of extra members all of which are zero. 

As in the case of representation of sequences by column matrices, the com¬ 
mutative property {<?} * {*} = {*} * {o} is abandoned. One of the sequences en¬ 
tering into the serial product is interpreted as a vector, and one in an entirely dif¬ 
ferent way To reverse the roles of {*} and {o}—for example, to talk of the vector 
A—would be unthinkable in physical fields where the vector interpretation is 
used. This apparent rigidification of the notation is compensated by greater gen¬ 
erality. To illustrate this we may note first that, to the extent that matrix methods 
are used for dealing with vectors, there is no distinction between the representa¬ 
tions of sequences as column matrices and as vectors. Now, examination of the 
square matrix in the preceding section that was built up from members of the se¬ 
quence {/} reveals that in each row the sequence {/} was written backward, the 
sequence shifting one step from each row to the next. This reflects the mode of 
calculation of the serial product, where the sequence {/} would be written on a 
movable strip of paper alongside a sequence {#} and shifted one step after each 
cycle of forming products and adding. In the procedure for taking serial products 
there is no provision for changing the sequence {/} from step to step. Indeed it 
is the essence of convolution, and of serial multiplication, that no such change oc¬ 
curs. But in the square-matrix formulation, it is just as convenient to express such 
changes as not. Thus the matrix notation allows for a general situation of which 
the serial product is a special case. 

This more general situation is simply the general linear transformation as con¬ 
trasted with the general shift-invariant linear transformation. If the indexing of a 
sequence is with respect to time, then serial multiplication is the most general 
time-invariant linear transformation, and would for example be applied in prob¬ 
lems concerned with linear filters whose elements did not change as time went 
by. If, on the other hand, one were dealing with the passage of a signal through 
a filter containing time-varying linear elements such as motor-driven poten¬ 
tiometers, then the relationship between output and input could not be expressed 
in the form of a serial product. In such circumstances, where convolution is in¬ 
applicable, the property referred to loosely as "harmonic response to harmonic 
excitation" also breaks down. 


CONVOLUTION BY COMPUTER 

Convolution gains extra importance in Fourier analysis because of the convolu¬ 
tion theorem which is taken up in Chapter 6, and it should be mentioned here 
that convolution can be based on fast transform algorithms as discussed in Chap- 
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ter 12. However, it is much more straightforward to code the hand calculation de¬ 
scribed in connection with Figure 3.9, and in applications to filtering long data 
sets this code will usually run faster than a transform method (both being writ¬ 
ten in the same language). Let f () and g () have lengths If and lg respec¬ 
tively; the convolution h( ) will have length lh equal to l£+lg-l. Here is the 
code for direct convolution. 

FOR I s 1 to lh 
h(I) = 0 

FOR J = MAX(l-lg+ 1,1) TO MIN(lf,I) 

K = I-J + 1 

h(l) = h(l) + f(J) * g(K) 

NEXT J 
NEXT I 


THE AUTOCORRELATION FUNCTION AND PENTAGRAM NOTATION 

The self-convolution of a function f(x) is given by 

/ * / = f /(“)/(* ~ “) du. 

J ~00 

Suppose, however, that prior to multiplication and integration we do not reverse 
one of the two component factors; then we have the integral 

f /(«)/(“ ~ *) du, 

which may be denoted by / ★ /. A single value of / ★ / is represented by the 
shaded area in Figure 3.11. A moment's thought will show that if the function / 
is to be displaced relative to itself by an amount x (without reversal), then the in¬ 
tegral of the product will be the same whether x is positive or negative. In other 
words, if f(x) is a real function, then / ★ / is an even function, a fact which is not 



Fig. 3.11 The autocorrelation function represented by an area (shown shaded). 
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true in general of the convolution integral. It follows that 

/*/= I /(«)/(“ " *) du = f /(“)/(" + x) du, 

J -OO J -oo 


which, of course, is deducible from the previous expression by substitution of 

iv = u — x. 

It is shown in the appendix to this chapter that the value of / ★ / at its ori¬ 
gin is a maximum; that is, as soon as some shift is introduced, the integral of the 
product falls off. 

When f(x) is complex it is customary to use the expression 

[ /(«)/*(« ~ x) du 

J -oo 


or f*(u)f(u + x) du. 

J oG 

(Note that it is possible to place the asterisk in the wrong place and thus obtain 
the conjugate of the standard version.) 

It is often convenient to normalize by dividing by the central value. Then we 
may define a quantity y(x) given by 

I /(«)/(« + x) du 

**>= - 

/(«)/(«) du 

J “OO 

and it is clear that 


7(0) = 1- 


We shall refer to y(x) as the autocorrelation function of f(x). However, it of¬ 
ten happens that the question of normalization is unimportant in a particular ap¬ 
plication, and the character of the autocorrelation is of more interest than the mag¬ 
nitude; then the nonnormalized form is referred to as the autocorrelation function. 

As an example, take the function /(x) defined by 


/(*) = 



x <0 
0 < x < 1 
x> 1. 


Then, for 0 < x < 1, 


f /(«)/(« + x ) du = [ (1 - m)[1 - (u + x)] du 

J -OO JO 

1 X X 3 

~ 3~ 2 + ~6' 


The best way to determine the limits of integration is to make a graph such as 
the one in Figure 3.11. Where x > 1, the integral is zero, and since the integral is 
known to be an even function of x, we have 
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f /(»)/(« + x) du = 

J -oo 



M \*l 
2 6 


-1 < x < 1 

1*1 > 1 . 


The central value, obtained by putting x — 0, is g; hence 

r(*) = I 


! _ 3|x| + |£p 


lo 


-1 < x < 1 

1*1 > I- 


We note that -y(O) = 1, and as with the convolution integral, the area under the 
autocorrelation function may be checked (it is 4 ) to verify that it is equal to the 
square of the area under f(x). 

A second example is furnished by 


/(*) = 



x> 0 
x < 0 . 


Then 


j /(«)/(u + x)du = j o e au e ^ X+U) du 

_ e 4x1 

2a ' 


and y(x) = e ***. 

The autocorrelation function is often used in the study of functions repre¬ 
senting observational data, especially observations exhibiting some degree of ran¬ 
domness, and ingenious computing machines have been devised to carry out the 
integration on data in various forms. In any case, the digital computation is 
straightforward in principle. In the theory of such phenomena, however, as dis¬ 
tinct from their observation and analysis, one wishes to treat functions that run 
on indefinitely, which often means that the infinite integral does not exist. This 
may always be handled by considering a segment of the function of length X and 
replacing the values outside the range of this segment by zero; any difficulty as¬ 
sociated with the fact that the original function ran on indefinitely is thus re¬ 
moved The autocorrelation -y(r) of the new function / x (.v), which is zero outside 
the finite segment, is given, according to the definition, by 


tW = 


[ /x*(«)/x(w + x) du 

J PC _ 

f /x(m)/x*(«) du 

J —OO 
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J*i „/*(")/(« + *)*' 


Thus the infinite integrals are reduced to finite ones, and, of course, this is 
precisely what happens in fact when a calculation is made on a finite quantity of 
observational data. 

Now if we are given a function f(x) to which the definition of y(x) does not 
apply because f(x) never dies out, and we have calculated y(x) for finite segments, 
we can then make the length X of the segment as long as we wish. It may hap¬ 
pen that as X increases, the values of y(x) settle down to a limit; in fact, the cir¬ 
cumstances under which this happens are of very wide interest. This limit, when 
it exists, will be denoted by C(x), and it is given by 


C(x) = lim 

A —*00 



As autocorrelation usually arises with real functions, such as signal waveforms, 
allowance has not been made for complex/( ). 

Exercise. Show that when this expression is evaluated for a real function for 
which y(x) exists, then C(x) = y(x). 

Since the limiting autocorrelation C is identical with y in cases where y is ap¬ 
plicable, it would be logical to take C as defining the autocorrelation function, 
and this is often done. In the discussion that follows, however, we shall under¬ 
stand the term "autocorrelation function" to include the operation of passing to 
a limit only where that is necessary. 

As an example of a function that does not die out and for which the infinite 
integral does not exist, consider a time-varying signal which is a combination of 
three sinusoids of arbitrary amplitudes and phases, given by 

V(t) — A sin (at + <f>) + Bsin(/3 1 + ,y) + Csin(yf + tp). 


Then 

| V(f')V(f' + t)dt' = j t [Asin (af' + </>) Asin («f' + at + <£) 

+ Bsin (/3 1' + x) Bsin (/3f' + /3 1 + x) 
+ Csin (y t' + i]r) Csin (yf + yt + i}/) 
+ cross-product terms] dt' 



44 


The Fourier Transform and Its Applications 


f J r 

= J } {A 2 [cos at — cos (2 at' + at + 2</>)] 

+ B 2 [cos pt - cos (2/3/' + pt + 2*)] 
+ C 2 [cos yt — cos (2 yt' + yt + 2ij/)] 
+ cross-product terms} dt' 

= A 2 T cos at + B 2 T cos pt + C 2 T cos yt + F(t,T ) + G(f,T), 


where F stands for oscillatory terms and G for terms arising from cross products. 
As T increases, F and G become negligible with respect to the three leading terms, 
which increase in proportion to T. Hence 



V{t')V(t’ + t) dt' 



A 2 T cos at + B 2 T cos pt + C 2 T cos yt + F(f,T) + G(t,T ) 
A 2 T + B 2 T + C 2 T + F(0,T)Tg(0,T) 


and 


C(0 = lim 


\[] T v (nv(t' + t) dt' 

\[ T mnfdr 


1 


A 2 + B 2 + C 2 


{A 2 cos at + B 2 cos pt + C 2 cos yt). 


Note that the limiting autocorrelation function C(f) is a superposition of three co¬ 
sine functions at the same frequencies as contained in the signal V(t), but with dif¬ 
ferent relative amplitudes, and that C(0) = 1. 

Since the principal terms in the numerator of y(x) increase in proportion to 
X, another way to obtain a nondivergent result is to divide by X before proceed¬ 
ing to the limit. The expression 

lim ^ [' /(«)/( u + x) du 

X-do X J-|x' v 


is not equal to unity at its origin but is generally referred to simply as the "auto¬ 
correlation function" because it becomes the same as C(x) if divided by its cen¬ 
tral value (provided the central value is not zero). It may therefore be regarded 
as a nonnormalized form of C(x). 

When time is the independent variable it is customary to refer to the time av¬ 
erage of the product V(f)V(f + t), and write 


(V(t)V(t + t)> ^ 7 lim ~ j’ [ r V(t)V(t + t) dt. 


where the operation of time averaging is denoted by angular brackets according 
to the definition 



chapter 3: Convolution 


45 


(■■■)= lim [* .. ■ dt. 

x ' T-*r* T J-Jr 

Using this notation for the example worked, we have 

(V(t)V(t + r)) = A 2 cos ar + B 2 cos (5 1 + C 2 cos yr. 


which, of course, is a little simpler than the normalized expression. It should be 
noticed, however, that we do not get a useful result in cases for which y exists. 

A conspicuous feature of C in this example is the absence of any trace of the 
original phases. Hence, autocorrelation is not a reversible process; it is not possi¬ 
ble to get back from the autocorrelation function to the original function from 
which it was derived. Autocorrelation thus involves a loss of information. In some 
branches of physics, such as radio interferometry and X-ray diffraction analysis 
of substances, it is easier to observe the autocorrelation of a desired function than 
to observe the function itself, and a lot of ingenuity is expended to fill in the lost 
information. 

The character of the lost information can be seen by considering a cosinu¬ 
soidal function of x. When this function is displaced relative to itself, multiplied 
with the unshifted function, and the result integrated, clearly the result will be 
the same as for a sinusoidal function of the same period and amplitude. Fur¬ 
thermore, the result will be the same for any harmonic function of x, with the 
same period and amplitude, and arbitrary origin of x. Thus the autocorrelation 
function does not reveal the phase of a harmonic function. Now, if a function is 
composed of several harmonic waves present simultaneously, then when it is dis¬ 
placed, multiplied, and integrated, the result can be calculated simply by consid¬ 
ering the different periods one at a time. This is possible because the product of 
harmonic variations of different frequencies integrates to a negligible quantity. 
Consequently, each of the periodic waves may be slid along the x axis into any 
arbitrary phase, without affecting the autocorrelation. In particular, all the com¬ 
ponents may be shifted until they become cosine components, thus generating an 
even function which, among all possible functions with the same autocorrelation, 
possesses a certain uniqueness. 

As autocorrelation usually arises with real functions, such as signal wave¬ 
forms, allowance has not been made for complex/. The autocorrelation of a com¬ 
plex function f(x) can be treated as a special case of cross correlation. 


THE TRIPLE CORRELATION 

Ordinary autocorrelation of a waveform abandons information about the direc¬ 
tion of time, which can be important. For example, random noise that is statisti¬ 
cally the same if the record is reversed can be obtained from a physical source; 
the same noise, passed through a simple KC-filter with impulse response 
exp (~t/RC)H(t) can be thought of as a superposition of exponential tails all 
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imprinted with the direction of time flow. Therefore the filtered noise may be sta¬ 
tistically different if played backwards. The autocorrelation function does not al¬ 
low us to investigate this because it tells nothing about the arrow of time. But 
there is a higher order property that does and has become important (Weigelt, 
1991), namely the triple correlation. It is a function U(x u x 2 ) of two variables de¬ 
fined as 


U(x If x 2 ) = f°° /(x)f(x + xj)/(x + x 2 )dx. 

J -CO 

For example, the triple correlations of {1 2 3} and {3 2 1} respectively are 
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and have come out differently, one being the transpose of the other. 


THE CROSS CORRELATION 

The cross correlation f(x) of two real functions g(x) and h(x) is defined as 

fix) = g + h = g(u - x)h(u) du. 

J -oo 

It is thus similar to the convolution integral except that the component g(u) is sim¬ 
ply displaced to g(u — x), without reversal. To denote this operation of g on h we 
use a five-pointed star, or pentagram, instead of the asterisk that denotes convo¬ 
lution. While cross correlation is slightly simpler than convolution, its properties 
are less simple. Thus, whereas g * h = h * g, the cross-correlation operation of h 
on g is not the same as that of g on h. It is a good idea to read g ★ h as 'g scans 

h.' As defined above g scans h to produce/, since h remains stationary while g 

moves with changing x. We now show that 

g*h*h*g. 

By change of variables it can be seen that 

fix) = g + h = | gin - x)hiu) du = j ^ giu)hiu + x) du 

fi~x) = h* g= I Hu - x)£(n) du = f /?(")$(» + x) du; 

J -oo J -Oo 

g*h =gi-)* h. 
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As in the case of the autocorrelation function, the cross correlation is often 
normalized so as to be equal to unity at the origin, and when appropriate the av¬ 
erage (g(u — x)h(u)) is used instead of the infinite integral. When the functions 
are complex it is customary to define the (complex) cross-correlation function as 
g * scans h, where g* is the complex conjugate of g: 

f no f oo 

g* ★ h = g*(u - x)h(u) du = g*(u)h(u + x) du. 

J -00 J -OO 

As a special case the complex autocorrelation of complex / is /* ★ /, which 
requires care because it is possible to put the asterisk in the wrong place and thus 
obtain the conjugate of the standard version. 


THE ENERGY SPECTRUM 

We shall refer to the squared modulus of a transform as the energy spectrum; that 
is, |F(s)| 2 is the energy spectrum of /(*). The term is taken directly from the phys¬ 
ical fields where it is used. It will be seen that there is not a one-to-one relation¬ 
ship between f(x) and its energy spectrum, for although f(x) determines F(s) and 
hence also |F(s)| 2 , it would be necessary to have 1 pha F(s) as well as |F(s)| in or¬ 
der to reconstitute f(x). Knowledge of the energy spectrum thus conveys a cer¬ 
tain kind of information about f(x) which says nothing about the phase of its 
Fourier components. It is the kind of information about an acoustical wave¬ 
form which results from measuring the sound intensity as a function of fre¬ 
quency. 

The information lost when only the energy spectrum can be given is of pre¬ 
cisely the same character as that which is lost when the autocorrelation function 
has to do duty for the original function. The autocorrelation theorem, to be given 
later, expresses this equivalence. 

When f(x) is real, as it would be if it represented a physical waveform, the 
energy spectrum is an even function and is therefore fully determined by its val¬ 
ues for s 3* 0. To stress this fact, the term "positive-frequency energy spectrum" 
may be used to mean the part of |F(s)| 2 for which s s* 0. 

Since iF(s)| 2 has the character of energy density measured per unit of s, it 
would have to become infinite if a nonzero amount of energy were associated 
with a discrete value of s. This is the situation with an infinitely narrow spectral 


'The phase angle of the complex quantity F(s) is written pha F(s) and is defined as follows: if there is 
a complex variable z = r exp iff, then pha z = 0. 



48 


The Fourier Transform and Its Applications 




Fig. 3.12 Spectra of X radiation from molybdenum: (a) power spectrum; (b) cumu¬ 
lative spectrum. 


line. Now we can consider a cumulative distribution function which gives the 
amount of energy in the range 0 to $: 

J' |F(s)| J rfs. 

Any spectral lines would then appear as finite’ discontinuities in the cumulative 
energy spectrum as suggested by Fig. 3.12, and some mathematical convenience 
would be gained by using the cumulative spectrum in conjunction with Stieltjes 
integral notation. The convenience is especially marked when it is a question of 
using the theory of distributions for some question of rigor. However, the matter 
is purely one of notation, and in cases where we have to represent concentrations 
of energy within bands much narrower than can be resolved in the given context, 
we shall use the delta-symbol notation described later. 


APPENDIX 

We prove that the autocorrelation of the real nonzero function /(*) is a maximum 
at the origin, that is, 

j ” /(«)/(« + x)du =£ [/(h )] 2 du. 

Let e be a real number. Then, if .t t 0, 

[ [/(«) t ef{u + x)] 2 du > 0 

J —"X> 

and I [/(h)] 2 du + 2e ( /(»)/( u + x) du + e 2 [ [/(« + jr)] 2 <fi/ > 0; 

J — OO J 'X) J -cc 
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that is, 
where 


ae 2 + be + c > 0 , 
a = c ={ [f{u)] 2 du 

J — OO 

b = 2 I f(u)f(u + x)du. 

J —00 


Now, if the quadratic expression in e may not be zero, that is, if it has no real root, 
then 

b 2 — 4 ac =£ 0 . 


Hence in this case b/2 a, or 


P /(“)/(“ + x) du 

1 . 

f°° [/(“)? du 

J -OO 

The equality is achieved at x = 0; consequently the autocorrelation function can 
nowhere exceed its value at the origin. The argument is the one used to establish 
the Schwarz inequality and readily generalizes to give the similar result for the 
complex autocorrelation function. 


Exercise. Extend the argument with a view to showing that the equality can¬ 
not be achieved by any value of x save zero. 
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PROBLEMS 

1. Calculate the following serial products, checking the results by summation. Draw 
graphs to illustrate. 

(a) {6 91720101} * {3 8 11} 

(b) {1 1 1 1 1 } * {1 1 1 1 } 

(c) {1 42 3 53 345769} * {1 1} 

(d) {14235334576 9} *{ 55 } 
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(e) {1 42353345769} * {1 21} 

(/) {142353345769} * {\i\} 

(#) {1 237121921 22 18 137532 1} * {1 -1} 

(Ji) {1 237121921 2221 181375321} * {1 1 1 1 ... } 

(0 {1 1} * {1 1} * {1 1} 

O') {1 1 0 0 1 0 1} * {1 100101} 

(k) {1100101}*{10100U} 

{/) {a bede} * {edcba) 

(m) {131}*{100000 ±1} 

(») { 131 } *{12 2 } 

(o) Multiply 131 by 122 

(p) Multiply 10,301 by 10,202 
(9) {181} *{12 2} 

(r) Comment on the smoothness of your results in d and/relative to the longer of the 
two given sequences. 

(s) Consider the result of i in conjunction with Pascal's pyramid of binomial coeffi¬ 
cients. 

(/) Seek longer sequences with the same property you discovered in k. 

(u) Contemplate j, k, I, ni, and n with a view to discerning what leads to serial prod¬ 
ucts which are even. 

(y) Master the implication of n, 0, p, and q, and design a mechanical desk computer to 
perform serial multiplication. 

2. Derive the following results, where H(x) is the Heaviside unit step function (Chap¬ 
ter 4): 

* e'H(x) = (2r* - x 2 - 2.v - 2 )H(x) 

[sinx H(x)]* 2 = j(sin x - x cos Jr)H(x) 

[(1 - x)H(x)] * [e'H(x)] = xH(x) 

H(x) * \e'H(x)} =(<?- l)H(.v) 

[e'H(x)]* 2 = xc'H(x) 

[e'Hlv)]* 3 = \x 2 e t H(x) 

3. Prove the commutative property of convolution, that is, that / * g = g * / 

4. Prove the associative rule / * (g */») = {/* g) * h. 

5. Prove the distributive rule for addition f*(g + h) = f*g + f*h. 

6. The function/is the convolution of g and h. Show that the self-convolutions of f,g, and 
h are related in the same way as the original functions. C> 

7 - M f ~ 8 * h, show that / * / = (g * g) * (fi * h). 

8. Show that if a is a constant, n(f * g) = ( af ) * g = f * (ag). 

9. Establish a theorem involving f(g * It). t> 

10. Prove that the autocorrelation function is hermitian, that is, that C(— u) - C*{u), and 
hence that when the autocorrelation function is real it is even. Note that if the autocor- 
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relation function is imaginary it is also odd; give some thought to devising a function 
with an odd autocorrelation function. 

11. Prove that the sum and product of two autocorrelation functions are each hermitian. t> 

12. Alter the origin of f{x) until / * f\ 0 is a maximum. Investigate the assertion that the 
new origin defines an axis of maximum symmetry, making any necessary modification. 
Investigate the merits of the parameter 

/*/lo 
/ */lo 

to be considered a measure of "degree of evenness." 

13. Show that if f(x) is real, 

f~ f(x)f(-x)dx= f°° [E(x )] 2 dx - [ X [0(x)) 2 dx, 

J ~oo J —oc J — OO 

and note that the left-hand side is the central value of the self-convolution of f(x); that 
is, / * /In- 

14. Find reciprocal sequences for {13 31} and {1 4 6 41}. 

15. Find reciprocal sequences for {1 1} and {1 1 1}. 

16. Establish a general procedure for finding the reciprocal of finite or semi-infinite 
sequences and test it on the following cases: 

{64 32168421 ...} 

{64 64 48 32 20 12 7 4 ...} 

{' ‘ rl/, “ cos (S) r!,, ° cos (w) ■- f ' ,,0cos (^) -} 

17. Find approximate numerical values for a function f(x) such that 

f(x) * [e-*H(x)} 

is zero when evaluated numerically by serial multiplication of values taken at intervals 
of 0.2 in X, except at the origin. Normalize /(r) so that its integral is approximately 
unity. C> 

18. The cross correlation g ★ h is to be normalized to unity at its maximum value. It is ar¬ 
gued that 

0 =€ | [g(u) - h(u + x)] 2 du = I g 2 du - 2 J g{u)h{u + x)du + j h 2 du, 
and therefore that 

| + x) du g 2 du + } | hi 2 du = M. 
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Consequently (g ★ h)/M is the desired quantity. Correct the fallacy in this argument. 

19. Barker code. Calculate the autocorrelation sequence of 

{ 11111 - 1 - 111 - 11-1 1 }. 

This sequence is known as the Barker code of length 13 (Pettit, 1967). By coin tossing, 
establish a similar 13-element sequence at random and calculate its autocorrelation. 

20. Convolution done analytically. 

(a) Make a graph of the convolution h(x) of the given functions f(x) and g(x), labeling 
both axes with numerical values. 




(b) Label any interesting points of h(x) with letters A,B,C, . . . and make a table of val¬ 
ues such as the following: 


Interesting 

point x h(x) 

A 
B 
C 


21. Self-convolution of sine function. Let f(x) = sine (x + 2) + sine (x — 2) What is the 
self-convolution of /(*)? 

22. Convolution. In the integral 

fix ~ u)g{u) du, 

J -OO 

make the substitution 


u = x — a, 


where a is a constant. Then 

Too (OO (oo 

\_ 00 fte - u )g( u )du = J f(a)g(x - a)dx = f(a) J ^g(x)dx. 
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Is this correct? If not, where is the fallacy in the derivation? 

23. Optical sound track. The optical sound track on old motion-picture film has a breadth 
b, and it is scanned by a slit of width w. With appropriate normalization, we may say 
that the scanning introduces convolution by a rectangle function of unit height and 
width u\ In a certain movie theater the projectionist clumsily dropped the whole pro¬ 
jector on the floor and after that the slit was always inclined at a small angle e to the 
striations on the sound track instead of making an angle of zero with them. 

(a) What function now describes the convolution that takes place? 

( b ) Describe qualitatively the effect on the sound reproduction. 

24. Numerical convolution compared with analytic. The exponential function e~ x may be 
represented discretely by the sequence 

{a} = {1 0.368 0.135 0.050 ...} 

(a) Calculate the serial product or "autocorrelation sum" 

2 a j a '+i 

>— 0 , 1 ,... 

and make an accurate graph. 

(b) Calculate the "autocorrelation function" 


K(t) = [°° f(x)f(x + T)dx 

J “OO 


when 


/(*) 


-fc 


x > 0 
x < 0 , 


and superimpose a graph of R(r) on the previous graph. 

(c) Naturally the continuous graph of K(r) does not pass exactly through the points cal¬ 
culated from part a. Discuss the discrepancy in terms of round-off error, normaliza¬ 
tion, or any other effects which you think may account for the disagreement. 

25. Two-dimensional convolution. The autocorrelation of two disks of unit diameter 
arises in the theory of optical instruments with circular apertures (and describes the 
two-dimensional transfer function). It is known as the Chinese hat function. Show that 


n(r) ** n(r) = chat r ~ |[cos 1 r - r(l 


-r ! )‘]n(0 


26. Two-dimensional autocorrelation. The two-dimensional autocorrelation function of 
n(x)n(y) is A(x)A(y). The central value is unity. 

(a) Verify that the contour A(jc)A(y) = e, where e is small compared with unity, is ap¬ 
proximately square. 

(b) Verify that the contour A(x)A(y) = 1 — 5, where 5 is small compared with unity, is 
also approximately square. 

(c) Choosing S = e, would you say that the two contours are equally square? 

27. Autocorrelation of a convolution. Show that 

(/ * g) * (/ * g) = (/ * /) * (g * g)- 
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28. Deconvolution. Three sequences are related by convolution as follows: 

{«o fl i a 2 - • • } * {bo bi b 2 ■ • } = {c 0 c, c 2 ... }. 

If the sequences {b*} and {c*} are given, show that the rule for inverting the convolution 
to obtain {a*} is 



Write a computer subprogram for inverting convolution. 

29. Transmission line echoes. When a current impulse is injected into a transmission line 
that is short-circuited at the far end the voltage appearing at the input terminals is a se¬ 
quence of equispaced impulses with coefficients {u} = {1 2 2 2 ..The current re¬ 
sponse if an impulse of voltage is applied is {»} = {1 -2 2 -2 2...}. (a) Show that 
M * {;} = {1}. (b) Find two functions v(t) and i{t) such that p(f)III(f) and /(f)III(f) re¬ 
spectively evoke the impulse trains. D> 

30. Deconvolution. Let {b*} be an unknown sequence and let = {111111}. Let {p*} 
be the periodic sequence of which one period is {011—1—10}. Verify that 
{ fl *} * {?*} = {0}- As in the previous problem, let {c*} = \a k } * {b*} be given. Is it not 
true that convolving {o t } with {b*} + {pj will also yield {c t }? If this is so, how can the 
deconvolution rule given above recover the unknown {b*.}? What, in fact, will the de- 
convolution algorithm produce? C> 

31. Speed of convolution. Specify a long data sequence/ with N elements, smooth it by 
convolution with # = {14641}, and obtain the elapsed time. We know that 
/*# = #*/, but does elapsed time depend on which sequence comes first? Does the 
time become proportional to N 2 as N increases? t> 




Notation for Some Useful Functions 


Many useful functions in Fourier analysis have to be defined piecewise because 
of abrupt changes. For example, we may consider the function/(x) such that 


/(*) = 



x < 0 

0 =s x s= 1 
X > 1. 


This function, though simple in itself, is awkwardly expressed in comparison with 
a function such as, for example, 1 + x 2 , whose algebraic expression compactly 
states, over the infinite range of x, the arithmetical operations by which it is 
formed. For many mathematical purposes a function which is piecewise analytic 
is not simple to deal with, but for physical purposes, a "sloping step function," 
or "ramp-step function," may be at least as simple as a smoother function. 

Fourier himself was concerned with the representation of functions given 
graphically, and according to English mathematician and historian E. W. Hobson 
"was the first fully to grasp the idea that a single function may consist of detached 
portions given arbitrarily by a graph." 

To regain compactness and clarity of notation, we introduce a number of sim¬ 
ple functions embodying various kinds of abrupt behavior. Also included here is 
a section dealing with sine x, the important interpolating function, which is the 
transform of a discontinuous function, and some reference material on notations 
for the Gaussian function. 


RECTANGLE FUNCTION OF UNIT HEIGHT AND BASE, FI(x) 

The rectangle function of unit height and base, which is illustrated in Fig. 4.1, is 
defined by 
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nw = < 


1*1 > \ 
1*1 = s) 
1*1 <*• 


It provides simple notation for segments of functions which have simple expres¬ 
sions, for example, f(x) = Tl(x) cos 7 tx is compact notation for 

(0 *< 2 

f(x) — \ COS TTX < X < 5 

[o l <x 


(see Fig. 4.2). We may note that frn[(* — c)/b] is a displaced rectangle function of 
height h and base b, centered onx = c (see Fig. 4.3). Hence, purely by multipli¬ 
cation by a suitably displaced rectangle function, we can select, or gate, any seg¬ 
ment of a given function, with any amplitude, and reduce the rest to zero. 



| n(x) 

_1_ 



_I_ 


Fig. 4.1 The rectangle function of unit height and base, n(x). 


Fig. 4.2 







x-c 

1 

1 

1 

J 

L 

h 

t 


< - b -► 

X 


Fig. 4.3 A displaced rectangle function of arbitrary height and base expressed in 
terms of IT(jc). 
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The rectangle function also enters through convolution into expressions for 
running means, and, of course, in the frequency domain multiplication by the rec¬ 
tangle function is an expression of ideal low-pass filtering. It is important in the 
theory of convergence of Fourier series, where it is generally known as Dirichlet's 
discontinuous factor. The notation rect x is in common use as a slightly less com¬ 
pact alternative to FI(*) and is useful in conversation Terms such as gate func¬ 
tion, window function, and boxcar function are also in use. 

For reasons explained below, it is almost never important to specify the val¬ 
ues at x = ± |, that is, at the points of discontinuity, and we shall normally omit 
mention of those values. Likewise, it is not necessary or desirable to emphasize 
the values FI(±|) = ^ in graphs; it is preferable to show graphs which are remi¬ 
niscent of high-quality oscillograms (which, of course, would never show extra 
brightening halfway up the discontinuity). 


TRIANGLE FUNCTION OF UNIT HEIGHT AND AREA, A(x) 


By definition. 


AW = S - M 


|*| > 1 
\x\ < 1. 


This function, which is illustrated in Fig. 4.4, gains its importance largely from 
being the self-convolution of Ll(*), but it has other uses—for example, in giving 
compact notations for polygonal functions (continuous functions consisting of lin¬ 
ear segments). 

Note that h\(x/\b) is a triangle function of height h, base b, and area {hb. 


VARIOUS EXPONENTIALS AND GAUSSIAN AND RAYLEIGH CURVES 

Figure 4.5 shows, from left to right, a rising exponential, a falling exponential, a 
truncated falling exponential, and a double-sided falling exponential. 



Fig. 4.4 The triangle function of unit height and area, A(x). 
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Figure 4.6 shows the Gaussian function exp (— 7 nr 2 ). Of the various ways of 
normalizing this function, we have chosen one in which both the central ordinate 
and the area under the curve are unity, and certain advantages follow from this 
choice. The Fourier transform of the Gaussian function is also Gaussian, and 
proves to be normalized in precisely the same way under our choice. In statistics 
the Gaussian distribution is referred to as the "normal (error) distribution with 
zero mean" and is normalized so that the area and the standard deviation are 
unity. We may use the term "probability ordinate" to distinguish the form 


1 


e 


-l* 7 . 


When the standard deviation is cr, the probability ordinate is 


_ : _ 

cr( 27 t) ; 

and the area under the curve remains unity. The central ordinate is equal to 
0.3989/rr. Prior to the strict standardization now prevailing in statistics, the error 
integral erf x was introduced as 


erf x — —7 [ e ' dt. 

77° J" 


The complementary error integral erfc x is defined by 

erfc x = 1 — erf x. 




Fig. 4.5 


Various expo¬ 
nential func¬ 
tions. 



Fig. 4.6 The Gaussian function exp (-77.T 5 ) and the probability ordinate 
(27r) - ' expf-^x 2 ). 


x 
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The probability integral a'(x), now widely tabulated, is 

a(x) = ——r ( e~l‘‘ dt = erf- 7 . 

(27t)- J -* 2* 

In this volume we use exp (—7 rx 2 ) extensively because of its symmetry under the 
Fourier transformation. Its integral is related to erf x and a(x) as follows: 

e~ n, ’dt = | erf 7T^x = |ar[(27r)^c] 

[ e~”‘ dt = \ + 2 erf tt 2 x = 5 + ^a[( 2 ir)^t]. 

J “CO 

The customary dispersion parameters of exp ( — 7 rx 2 ) are (see Fig. 4.6) as follows: 

(a) Probable error = 0.2691 = 0.6745<r 

( b ) Mean absolute error (mean of |x|) = 7 r _I = 0.3183 = 0.7979a 

(c) Standard deviation (mean of .v 2 ) = ( 2tt )~* = 0.3989 = a 

(d) Width to half-peak = 0.9394 = 2.355<r 

(e) Equivalent width = 1.0000 = 2.5066 <t 

The probable error, or semi-interquartile range, characterizes the middle 50 
percent of a set of measurements. A statistical report such as "the students have 
an average height of 165±10 cm" means that half the students are in the range 
155 to 175 cm, unless some other measure of spread is specified. For comparison, 
those departing from the mean of a normal distribution by less than one standard 
deviation are expected to number 62.27 percent, by less than the mean absolute 
error 57.51 percent, by less than the semiwidth to half peak 76.10 percent, and by 
less than the semi-equivalent width 78.99 percent. 

In two dimensions the Gaussian distribution generalizes to 

e -vix** tf), 

again with symmetry under the Fourier transformation, with unit central ordi¬ 
nate, and with unit volume. The version used in statistics, for arbitrary standard 
deviations a x and <r v , is 


1 




2t7ct x ay 

Under conditions of circular symmetry, and putting x 2 + y 2 = r 2 , the two- 
dimensional probability ordinate becomes 


lira 2 


r 1 la 2 


The probability R(r)dr of finding the radial distance in the range r to r + dr is 
27rr dr times the above expression; hence 
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This is referred to as Rayleigh's distribution, since it occurred in the famous prob¬ 
lem of the drunkard's walk discussed by Rayleigh. In a simple version of the prob¬ 
lem the drunkard always falls down after taking one step, and the direction of 
each step bears no relation to the previous step. After a long time has elapsed, the 
probability of finding him at (x,y) is a two-dimensional Gaussian function (ac¬ 
cording to which he is more likely to be at the origin than elsewhere), and the 
probability of finding him at a distance r from the origin is given by a Rayleigh 
distribution. Since the Rayleigh distribution has a peak that is not at the origin, 
the above statements may appear contradictory. If they do, the reader will find it 
instructive to contemplate the matter further. 

Here are some integrals and derivatives often needed for checking: 

^ e-**dx = 1 f% **dx = tt* f~ e V = (277)* 

J -OO J -'X J -oo 

j »2 

—e~^ = -2irxe -rze-"** = -2tt(1 - 27rx 2 )e~ nx \ 

ax ax~ 

Sequences of Gaussian functions play a special role in connection with trans¬ 
forms in the limit. The sequence exp ( — ttt 2 x 2 ) as r approaches zero is useful for 
multiplying with functions whose integrals do not converge. The limiting mem¬ 
ber of the sequence is unity. The sequence |r | -1 exp (-tt^/t 2 ) is used for recov¬ 
ering ordinary functions, in cases of impulsive behavior, by convolution. The prop¬ 
erties which make the Gaussian function useful in these contexts are that its 
derivatives are all continuous and that it dies away more rapidly than any power 
of x; that is, 

lim = 0 

for all n. 

Figure 4.7 shows these 1 two important sequences; later we emphasize that cor¬ 
responding members are Fourier transform pairs. 





Fig. 4.7 Standard sequences of Gaussian functions. 


x 
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H(x) 


_I_1_ 1 _ 

x 

Fig. 4.8 The unit step function. 


HEAVISIDE'S UNIT STEP FUNCTION, H(x ) 


An indispensable aid in the representation of simple discontinuities, the unit step 
function is defined by 

{ 0 * < 0 

(2 * = 0 ) 

1 .v > 0, 

and is illustrated in Fig. 4.8. It represents voltages which are suddenly switched 
on or forces which begin to act at a definite time and are constant thereafter. Fur¬ 
thermore, any function with a jump can be decomposed into a continuous func¬ 
tion plus a step function suitably displaced. As a simple example of additive use, 
consider the rectangle function n(x), which has two unit discontinuities, one pos¬ 
itive and one negative. If these are removed, nothing remains. Hence IT (at) is ex¬ 
pressible entirely in terms of step functions as follows (see Fig. 4.9): 



Since multiplication of a given function by H(x) reduces it to zero where x is 
negative but leaves it intact where x is positive, the unit step function provides a 
convenient way of representing the switching on of simply expressible quantities. 
For instance, we can represent a sinusoidal quantity which switches on at t = 0 
by sin t H(t) (see Fig. 4.10). A voltage which has been zero until t = t 0 and then 
jumps to a steady value £ is represented by EH(l — t 0 ) (see Fig. 4.11). 

The ramp function R(x) = xH(x) furnishes a further example of notation in¬ 
volving H{. y) multiplicatively (see Fig. 4.12). ( F/m)R(t ) represents the velocity of 
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Fig. 4.10 Graphs of sin t and sin t Hit) which exhibit a principal use of the unit 
step function. 


CH(I - to) 


f n 


C 


t 


Fig. 4.11 A voltage E which appears at 
t = t 0 represented in step- 
function notation by 
EHU - t 0 ). 



Fig. 4.12 


The ramp function 
xHlv). 


a mass m to which a steady force FH(t) has been applied, or the current in a coil 
of inductance nt across which the potential difference is FH(t). It will be seen that 
jR(y) is also the integral of //(.\) and, conversely, that H{x) is the derivative of R(x). 
Thus 


jR(.v) = | 

and jR'(x) = H(x). 

Step-function notation plays n role in simplifying integrals with variable lim¬ 
its of integration by reducing the integrand to zero in the range beyond the orig¬ 
inal limits. Then constant limits such as —oc to oo or 0 to oo can be used. For ex¬ 
ample, the function H(x — .v') is zero where .y' > x, and therefore f* f(x')dx' 
can always be written /' f(x’)H(x - x')dx'. Thus in the example appearing 
above we can write 

R(x) = f 1 H(x')dx r =| H(x’)H(x - x')iix’. 

J --X J -<x 

This last integral rev eals the character of R(x) as a convolution integral. 
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Fig. 4.13 The shaded area is x /(.v’) dx', or a value of the convolution of fix) 
with H(r). 


R(x) = H(x) * H(x), 

and in general we may now note that convolution with H{x) means integration 
(see Fig. 4.13) provided the integrals exist: 

H(x)*f(x)= \] f(x')H(x - x')dx' = j' f(x')dx' 

or f(x) = */(*)]. 

Usually, it is not important to define H( 0), but for the sake of compati¬ 
bility with the theory of single-valued functions it is desirable to assign a 
value, usually Certain internal consistencies are then likely to he observed. 
For instance, in the equation K'(.v) = H(.v) it is clear that R'(0 + ) = //(0+) = 1 
and that R’(O-) = H( 0—) = 0, and if we deem /\’(0) to mean 
lim Al _, 0 [ R(x + \ lx) - R(x - \ A.v)]/A.r, we find K'(0) = Furthermore, the 
Fourier integral, when it converges at a point of discontinuity, gives the midvalue. 

However, there is no obligation to take H(0) = it is not uncommonly taken 
as zero. This is a natural consequence of a point of view according to which (see 
Fig. 4.14) 

H(x) = Jim [(1 - e l T )H(.v)]. 

a 

Then H(0) = 0. The circumflex indicates that there is a slight difference from the 
definition already decided on. 


»(x) 


(a) 




(c) 


Fig. 4.14 (a) The function IHx); (b) an approximation to Htv); (c) the integral of (b). 
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Thus 


and 

H{x) = H(x) + l 2 8°(x) 

where 

*■{: 


The function <§°(x) is one of a class of null functions referred to below. No dis¬ 
crepancy need arise from the relation R'(x) = H{x), since the integral of H(x), re¬ 
garded as 

lim f* (1 - e~ u/T )H(u) du, 

J—»0 J -CX, 

is certainly R(x); and K'(0), regarded as the limiting slope at x = 0 of approxima¬ 
tions such as those shown in Fig. 4.14c, is certainly equal to /tT( 0), namely, 0. 

It is sometimes useful to have continuous approximations to H(x). The fol¬ 
lowing examples all approach H(x) as a limit for all x as r —> 0. 

i 1 x 

* + — arctan - 

77 T 


i 1 trx f* . u 

5 -Si -— = t sine — du 

77 T J -oo r 

, . ( *(1 - e- x/T ) x > 0. 

2 \-|(l - e x/T ) X <0. 


fi(l-e^) *>0. 

2 \-J(l - e x/T ) x < 0. 

An example which approaches H(x) as t —>0 for all x except x = 0 is 


fM 


,T) {l - 


X < —T 

)/T jr > —t. 


In this case 


Hm/M - H(x) + (| - 


since /(0,r) = 1 — e 1 for all r. A further example which approaches H(x) as r—>0 is 


l-V ' A (~r~) rfl '' 


The difference between H{x) and any version such that H(0) =£ ^ is a null func¬ 
tion whose integral is always zero. If it were necessary to make physical obser¬ 
vations of a quantity varying as H(x) or H(x), with the finite resolving power to 
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which physical observations are limited, it would not be possible to distinguish 
between the mathematically distinct alternatives, since the weighted means over 
nonzero intervals, which are the only quantities measurable, would be unaffected 
by the presence or absence of null functions. For physical applications of H(x) it 
is therefore perhaps more graceful not to mention H(0). 


THE SIGN FUNCTION, sgn x 


The function sgn x (pronounced signum x) is equal to +1 or -1, according to the 
sign of x (see Fig. 4.15). Thus 


sgn x 



x < 0 
x > 0. 


Clearly it differs little from the step function H(x) and has most of its properties. 
It has a positive discontinuity of 2. The relation to H(x) is 

sgnx = 2 H(x) - 1. 

However, lim,,.^ J A A sgn x dx = 0, whereas J 00 ^ H(x) does not exist. Further¬ 
more, we may note that sgn x, unlike H(x), is an odd function, and this property 
distinguishes it sharply from H(x), which has both even and odd parts. 



Fig. 4.15 The odd function sgn x. 


THE FILTERING OR INTERPOLATING FUNCTION, sine x 
We define 

sin7rx 
7 tx 


sincx — 
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a function with the properties that 

sine 0 = 1, 

sine « = 0 n = nonzero integer 

f 00 

; sincxdx = l. 

J -oc 

This function will appear so frequently, in many different connections, that it 
is convenient to have a special symbol for it, especially in some agreed normal¬ 
ized form. In the form chosen here, the central ordinate is unity and the total area 
under the curve is unity (see Fig. 4.16 a); the word "sine" appears in Woodward 
(1953) and has achieved some currency. A table of the sine function appears on 
page 508. 

The unique properties of sine x go back to its spectral character: it contains 
components of all frequencies up to a certain limit and none beyond. Further¬ 
more, the spectrum is flat up to the cutoff frequency. By our choice of notation, 
sine x and fl(s) are a Fourier transform pair; the cutoff frequency of sine x is thus 
0.5 (cycles per unit of x). 

When sine x enters into convolution it performs ideal low-pass filtering; that 
is, it removes all components above its cutoff and leaves all below unaltered, and 
under certain special circumstances discussed later under the sampling theorem, 
it performs an important kind of interpolation. 

In terms of the widely tabulated sine integral Si x (shown in Fig. 4.16c), where 

( x sinw 

Si x = -- du, 

JO u 


we have the relations 


sine u du = 
Jo 


sine x = 


Si (77X) 

7T 

d Si (7rx) 


dx 7 T 

and for the integral of sine x (see Fig. 4.166) we have 


[X 1 

H(x) * sine x = sine u du — — 

J -oc 2 


Another frequently needed function, tabulated on 
sine x (see Fig. 4.17): 


Si (7TX) 

7r 

page 508, is the square of 


sine 2 x = 



This function represents the power radiation pattern of a uniformly excited an¬ 
tenna, or the intensity of light in the Fraunhofer diffraction pattern of a slit. Nat¬ 
urally, it shares with sine x the property of having a cutoff spectrum, since squar- 
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(c) 

Fig. 4.16 (a) The filtering or interpolating function sine x; (b) its integral; (c) the 

sine integral Si x. 

ing cannot generate frequencies higher than the sum-frequency of any pair of si¬ 
nusoidal constituents. A little quantitative thought along the lines of this appeal 
to physical principles would soon reveal that the Fourier transform of sine 2 x is 
A(s). The cutoff frequency is one cycle per unit of x. 
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Fig. 4.17 



x 


The square of sine x and its integral. 


Among the properties of sine 2 x are the following: 

sine 2 0=1 

sine 2 n = 0 n = nonzero integer 


! sine 2 xdx = 1 . 

J -oo 

In two dimensions a function analogous 


to sine x is 


/ i(w) 

jmc r = —, 

which has unit volume, a central value of 7 t/4 , and a two-dimensional Fourier 
transform FI(s). Another generalization to two dimensions, which has analogous 
filtering and interpolating properties, is 

sine x sine y. 

The two-dimensional Fourier transform of this function is n(w)n(i>). 


PICTORIAL REPRESENTATION 

Certain conventions in graphical representations will be adopted for the pur¬ 
pose of clarity. For example, theorems relating to Fourier transforms will be il¬ 
lustrated, where possible, by examples which are real. In these diagrams the 
points where the abscissa and ordinate are equal to unity are marked if it is ap¬ 
propriate to do so. 

In representing purely imaginary quantities a dashed line is always used; 
hence complex quantities may be shown unambiguously and clearly by their real 
and imaginary parts (see Fig. 4.18). 
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Fig. 4.18 Representation of a complex function F(s) by its real and imaginary 
parts. 



Fig. 4.19 Complex function shown in modulus and phase. 
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■ TABLE 4.1 

Special symbols 


Function 

Notation 


Rectangle 

nw * {J 

W<5 

\x\>\ 


Triangle 

Mr 1 

|X|<1 

W>1 


Heaviside unit step 

HM - {° 

x > 0 

x < 0 


Sign (signum) 

sgnx = | ’ 

X > 0 

x < 0 


Impulse symbol* 

S(x) 



Sampling or replicating symbol* 

lll(x) = 2 S(x - 

”) 


Even impulse pair 

ii(at) = + i) + - i) 


Odd impulse pair 

= ifi(x + \) - 

]«(* - \) 


Filtering or interpolating 

sin7rx 

sine x = 

TTX 



Jinc function 

Ji(™) 

) ,nc -- 2, 



Asterisk notation for convolution 

/(*) * g(x) a | 

f(u)g(x - u)du 

(p- 24) 

Asterisk notation for serial products 

/ 

(p- 31) 

Pentagram notation 

/(*) * g(x) A [°° f(u)g(x + u) du 

J ~oo 

(p. 40) 

Various two-dimensional functions 

2 n(x,y> = n(x)n(y) 

2 8(x,y) = fi(x) %) 

2 III(x,y) = III(x)III(y) 

2 sinc (x,y) = sine x sine y 



*See Chapter 5. 
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Sometimes a complex function may be shown to advantage by plotting its 
modulus and phase, as in Fig. 4.19. Another method is to show a three-dimen¬ 
sional diagram (see Fig. 4.20), and a third method is to show a locus on the com¬ 
plex plane (see Fig. 4.21). 


SUMMARY OF SPECIAL SYMBOLS 

A small number of special symbols which are used extensively throughout this 
work are summarized in Table 4.1 and in Fig. 4.22 for reference. 
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PROBLEMS 

1. Show that 

H(ax + b) = < 

l H 

and hence that 

H(ax + b) = H^x + + H^-x - 

2. Discuss the function |[1 + x/tx 2 )*] used by Cauchy. 

3. Show that the operation H(x) * is an integrating operation in the sense that 

H(x) * [/(x)H(x)] = j'f(x)dx 

4. Calculate (d/dx)[n(x) * H(x)] and prove that (d/dx)[/(x) * H(x)] = f(x). 

5. By evaluating the integral, prove that sine x * sine x = sine x. 

6. Prove that sine x * }o(rrx) = 

7. Prove that 4 sine 4x * sinx = sinx.O 

8. Show that 

ri(x) = H(x + \) - H(x - I) 

= H(| + x) + H(| - x) - 1 
= H(i - X 2 ) 

= |[sgn (X + ^) - sgn (x - ^)] 

and that n(x 2 ) = n(x/2^). 

9. Show that 

A(x) = ri(x) * n(x) 

= n(x) * h(x + |) - n(x) * h(x - \). 

10. Experiment with the equation /[/(x)] = /(x) and note that /(x) = sgn x is a solution. 
Find other solutions and attempt to write down the general solution compactly with 
the aid of step-function notation. 

11. Show that erf x = 2<J>(2*crx) — 1, where 

f* 1 

4>(x) = -r 

' 00 cr(2 tt )\ 


G + ») * s ° 
(-’-ID ° <o - 
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12. Show that the first derivative of A(x) is given by 

A'(x) = -nQsgnx 

and calculate the second derivative. D> 

13. In abbreviated notation the relation of A(x) to n(x) could be written A = n * FI or 
A = IT* 2 . Show that 

n * 2 = n - a = frr + ii) 3 n(* ■+ i) + (^ - x 2 )n(x) + |(x - i^) 2 n(x - i). 

Show also that 

n* 2 = + l^) 2 H(x + li) - l(x + i) 2 H(x + 1) + i(x - ’) 2 H(x - I) 

- |(x - l|) 2 H(x - li). 

14. Examine the derivatives of n* 1 at x = and x = 1^± and reach some conclusion 
about the continuity of slope and curvature. 

15. Show that (<i/dx)|x| = sgn x and that ( d/dx ) sgn x = 26(x). Comment on the fact that 

d 2 |x| d 2 


16. Notation. Prove that 

H(x) * H(x + 1) - H{x) * H(x - 1) = A(x), 
or, if the RHS is not correct, derive the correct expression. 

17. Notation. Prove that 


— {[A(x)] 2 } = — A(x) sgn x, 

or, if the RHS is not correct, derive the correct expression. 

18. Derivatives of the sine function. Show that 

COS7TX sin 7TX 


sinc'(.x) = 


7TX 2 ' 

2x + 7rV 


sinc"(x) = —j cos 7rx +- - — sin 7rx. 

X~ TT.l 


19. Integrals of the jinc function. When the jinc function was introduced it was mentioned 
that J 0 ' jinc r2nr dr - 1, i.e., regarded as a function of radius in two dimensions, 
the volume under the jinc function is unity. Confirm that jincxdx is also equal to 
unity. t> 





The Impulse Symbol 


It is convenient to have notation for intense unit-area pulses so brief that mea- 
suring equipment of a given resolving power is unable to distinguish between 
them and even briefer pulses. This concept is covered in mechanics by the term 
"impulse." The important attribute of an impulse is its integral; the precise de¬ 
tails of its form are unimportant. The idea has been current for a century or more 
in mathematical circles. For historical examples from the writings of Hermite, 
Cauchy, Poisson, Kirchhoff, Helmholtz, Kelvin, and Heaviside, see van der Pol 
and Bremmer (1955). The notation 8{x), first used by G. Kirchhoff, was subse¬ 
quently introduced into quantum mechanics in 1927 by Dirac (1947), and is now 
in general use. The underlying concept permeates physics. Point masses, point 
charges, point sources, concentrated forces, line sources, surface charges, and the 
like are familiar and accepted entities in physics. Of course, these things do not 
exist. Their conceptual value stems from the fact that the impulse response—the 
effect associated with the impulse (point mass, point charge, and the like)—may 
be indistinguishable, given measuring equipment of specified resolving power, 
from the response due to a physically realizable pulse. It is then a convenience to 
have a name for pulses which are so brief and intense that making them any 
briefer and more intense dot's not matter. 

We have in mind an infinitely brief or concentrated, infinitely strong unit-area 
impulse and therefore wish to write 

8{x) = 0 x * 0 

and [ S(.t)d.t = l. 

J -oc 

However, the impulse symbol 1 6(.v) does not represent a function in the sense in 
which the word is used in analysis (to stress this fact Dirac coined the term "im- 


’1 use the word "symbol" systematically to signpost the entities that are not functions; one may also 
use the term "generalized function," introduced in 1953 by G. Temple. However, the distinction be¬ 
tween a function/(v) and the entity S(x) is glossed over in casual writing, where "delta function" is 
in common use for the understandable reason that fi(x) handles like a function. 
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proper function"), and the above integral is not a meaningful quantity until some 
convention for interpreting it is declared. Here we use it to mean 

lim f°° T -‘n (-W 

T -.0 J-oo \TJ 

The function t 1 V\(x/t) is a rectangle function of height r -1 and base r and has 
unit area; as t tends to zero a sequence of unit-area pulses of ever increasing height 
is generated. The limit of the integral is, of course, equal to unity. In other words, 
to interpret expressions containing the impulse symbol, we fall back on certain 
sequences of finite unit-area pulses of brief but nonzero duration, and of some 
particular shape. We perform the operations indicated, such as integration, dif¬ 
ferentiation, multiplication, and then discuss limits as the duration approaches 
zero. There is some convenience mathematically in taking the pulse shape to be 
always Gaussian; obviously, one has to prepare for possible awkwardness in re¬ 
taining U(x) as a choice, where differentiation is involved. However, the essence 
of the physics is that the pulse shape should not matter, and we therefore pro¬ 
ceed under the expectation that the choice of pulse shape will remain at our dis¬ 
posal. 

We adapt our approach to each case as it arises. Later we give a systematic 
presentation of the theory of generalized functions, a rigorously developed ex¬ 
position of the sequence idea in tidied-up mathematical form. 

The need to broaden Fourier transform theory was mentioned earlier in con¬ 
nection with functions, such as periodic functions, which do not possess Fourier 
transforms. The term "transform pair in the limit" was introduced to describe 
cases where one or both members of the transform pair are generalized functions. 
All these cases can be expressed with the aid of the impulse symbol and its de¬ 
rivatives, S(x), S'(x), and so on, which thus furnish the notation for the broadened 
theory. 

The convenience of the impulse symbol lies in its reserve over detail. As a 
specific example of the relevance of this feature to physical systems, consider an 
electrical network, say a low-pass filter. An applied pulse of voltage produces a 
certain transient response, and it is readily observable, as the applied pulses are 
made briefer and briefer, that the response settles down to a definite form. It is 
also observable that the form of the response is then independent of the input 
pulse shape, be it rectangular, triangular, or even a pair of pulses. This happens 
because the high-frequency components, which distinguish the different applied 
pulses, produce negligible response. The network is thus characterized by a cer¬ 
tain definite, readily observable form of response, which can be elicited by a mul¬ 
tiplicity of applied waveforms, the details of which are irrelevant; it is necessary 
only that they be brief enough. Since the response may be scrutinized with an os¬ 
cilloscope of the highest precision and time resolution, we must, of course, be pre¬ 
pared to keep the applied pulse duration shorter than the minimum set by the 
quality of the measuring instrument. The impulse symbol enables us to make ab¬ 
breviated statements about arbitrarily shaped indefinitely brief pulses. 

An intimate relationship between the impulse symbol and the unit step func¬ 
tion follows from the property that S(x') dx' is unity if x is positive but zero 
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if x is negative. Hence 

T S(x')dx’ = H(x). 

J -CO 


This equation furnishes an opportunity to illustrate the interpretation of an ex¬ 
pression containing the impulse symbol. First we replace £(x) by the pulse se¬ 
quence T~ l n(x/T) and contemplate the sequence of integrals 


f- 


OO 


r~ l n 



dx\ 


As long as r is not zero or infinite, each such integral is a function of x that may 
be described as a ramp-step function, as illustrated in Fig. 5.1. Now fix x, and con¬ 
sider the limit of the sequence of values of the integral generated as r approaches 
zero. We see that if we have fixed on a positive (negative) x, then the limit of the 
integral will be unity (zero). Therefore, in accordance with the definition of H(x) 
we can write 




Fig. 5.1 A rectangular pulse sequence and the sequence of ramp-step functions 
obtained by integration. 
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The equation 



« H(x). 



dx' = H(x) 


is shorthand for this. 

Since under ordinary circumstances 

= g(x) 


implies that 


one writes by analogy 


a*) = m 


w = ^ H ^ 


and states that "the derivative of the unit step function is the impulse symbol." 
Since the unit step function does not in fact possess a derivative at the origin, this 
statement must be interpreted as shorthand for "the derivatives of a sequence of 
differentiable functions that approach H(x) as a limit constitute a suitable defin¬ 
ing sequence for 8(x)." The ramp-step functions of Fig. 5.1 are differentiable and 
approach H(x). Since the amount of the step is in all cases unity, the area under 
each derivative function is unity, thus qualifying the sequence of derivative func¬ 
tions as a suitable sequence to define a unit impulse. 

It is not necessary to deal in terms of sequences of rectangle functions to discuss 
impulses. Representations of 8(x) in terms of various pulse shapes include the 
following sequences, generated as r approaches zero (through positive values). 

The sequence 



is composed of rectangle functions, all having their left-hand edge at the origin; 
it is often considered in the analysis of circuits where transients cannot exist prior 
to t = 0, the instant at which some switch is thrown. If one uses this sequence in¬ 
stead of the centered sequence, the results will not necessarily be the same. This 
is discussed below in connection with the sifting property. The sequence 

T -1 t> - nx’/j* 

of Gaussian profiles, which has been mentioned previously, has the convenient 
property that derivatives of all orders exist. On the other hand, these profiles lack 
the convenience of being nonzero over only a finite range of x. The sequence 



78 


The Fourier Transform and Its Applications 


t -1 A 



of triangle functions is useful for discussing situations where first derivatives are 
needed, since the profiles are continuous. In addition, they have an advantage in 
being zero outside the interval in which |x| < r. The sequence 


— 1 * 

r sine — 


has the curious property of not dying out to zero where x ¥= 0; at any value of x 
not equal to zero the value oscillates without diminishing as r -»0. The sequence 
serves perfectly well to define S(x) for a reason that is given below in connection 
with the sifting property. The resonance profiles 


r 

7 T(X 2 + T 2 ) 


decay rather slowly with increasing x. A product with an arbitrary function may 
well have infinite area. To eliminate this possibility completely, one is led to con¬ 
template sequences that are zero outside a finite range, thus obtaining freedom 
to accept products with functions having any kind of asymptotic behavior. In 
addition, one would like to have derivatives of all orders exist. The expression 


exp 


-1 


L1 - (*A) 2 



is a specific example of a sequence of profiles, each of which is zero outside the 
interval in which |x| < r, and each of which possesses derivatives of all orders. 
To see that it is possible for a function to descend to zero with zero slope, zero 
curvature, and all higher derivatives zero, differentiate the function 

e x/x H(x), 

and evaluate the derivatives at x = 0. There may seem to be a clash with the 
Maclaurin formula, according to which 

/(*) = /(0) + */'(0) + ~f"( 0) + ... + ^/ ( "'(0) + remainder. 


In the case of many functions familiar from analysis, the remainder term can be 
shown to vanish as n —*■ oo. In the case we have chosen here, however, the first n + 1 
terms vanish and the remainder term contains the whole value of the function. 


THE SIFTING PROPERTY 

Following our rule for interpreting expressions containing the impulse symbol, 
we may try to assign a meaning to 
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f°° &{x)f(x)dx. 

J -oo 

Thus we substitute the sequence r ’n(x/r) for 5(x) / perform the multiplication 
and integration, and finally take the limit of the integral as r —►{): 

In Fig. 5.2 the integrand is indicated in broken outline. Its area is r -1 times the 
shaded area. The shaded area, whose width is r and whose average height is ap¬ 
proximately /(0), amounts to approximately r / (0). Hence the area under the in¬ 
tegrand approaches /(0) as r approaches zero. Thus we write 

f°° 8{x)f{x)dx = /(0) 

and refer to this statement as the sifting property of the impulse symbol, since 
the operation on f(x) indicated on the left-hand side sifts out a single value of 
f(x). It will be seen that it is immaterial what sort of pulse is incorporated in the 
integrand, and this fact is the essence of the utility of 8(x). It just stands for a unit 
pulse whose duration is much smaller than any interval of interest, and conse¬ 
quently whose pulse shape means nothing to us; only its integral counts. It will 
be represented on graphs (see Fig. 5.3) as a spike of unit height, and impulses in 
general will be shown as spikes of height equal to their integral. 

It is clear that we can also write 

f ' 8 ( x ~ a )f( x ) dx = /(«) 

J —OO 



Fig. 5.2 Explaining the sifting property. The shaded area is approximately r/(0). 
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r 



Fig- 5.3 


Graphical representation of the 
impulse symbol fi(x) as a spike of 
unit height. 


and [ 8(x)f(x — a) dx = 

J - JO 

The resemblance to the convolution integral can be emphasized by writing 

f OO f OG 

8(x')f(x - x') dx' = 8(x - x')f{x')dx' = /( x) 

J -OO J -OC 


or, in asterisk notation. 


S(*) * f{x) = f(x) * 8(x) = f{x). 


If f{x) has a jump at x = 0, a little thought devoted to a diagram such as 
Fig. 5.2 will show that the sifting integral will have a limiting value of 
l[/(0 + ) + /(0—)]. Consequently, it is more general to write 


/(*+) + /(*“) 
8(x) * f(x) =---. 


The expression on the right-hand side differs from f(x) only by a null function, 
and hence the refinement is ordinarily not important. This does not alter the fact 
that \[f(x+) + /(*-)] can be different in value from/(.r). 

The asymmetrical sequence T^n (x — \t)/t] mentioned above will be seen 
to have the property of sifting out f{x + ). At points of discontinuity of f(x), the 
use of this asymmetrical sequence therefore gives a different result. In transient 
analysis, where discontinuities at the switching instant t = 0 are particularly com¬ 
mon, the choice of sequence can thus appear to give different answers. The dif¬ 
ference, however, can only be instantaneous. 

The impulse symbol has many fascinating properties, most of which can be 
proved easily. An important one which must be watched carefully in algebraic 
manipulation is 

%*) = -T| 5 (*); 

that is, if the scale of x is compressed by a factor a, thus reducing the area of the 
pulses which previously had unit area, then the strength of the impulse is reduced 
by the factor |<?]. The modulus sign allows for the property 

S(~x) = 8(x). 
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From this it would seem that the impulse symbol has the property of evenness; 
however, we gave an equation earlier involving a sequence of displaced rectan¬ 
gle functions which were not themselves even (Prob. 19, Chapter 5). 

It can easily be shown by considering sequences of pulses that we may write, 
if/(x) is continuous at x = 0, 

f(x) 8(x) = /(0) 8(x). 

From the sifting property, putting /(x) = x, we have 

x S(x) dx = 0. 

J -00 


One generally writes 


x <5(x) = 0, 


although if the prelimit graphs are contemplated, it will be seen that this equa¬ 
tion conceals a nonvanishing component reminiscent of the Gibbs phenomenon 
in Fourier series. Thus it is true that 

lim xr~ 1 n^^J=0 for all x; 


nevertheless, 

_ i 
“ i> 

max 

and, moreover, the limit of the minimum value is Consequently, among those 
functions which are identically zero, x8(x) is rather curious, and one has the feel¬ 
ing that if it could be applied to the deflecting electrodes of an oscilloscope, one 
would see spikes. 


lim 

T —>0 


XT 




THE SAMPLING OR REPLICATING SYMBOL III(x) 

Consider an infinite sequence of unit impulses spaced at unit interval as shown 
in Fig. 5.4. Any reservations that apply to the impulse symbol 6(x) apply equally 


III(X) 

* r a 


X 


Fig. 5.4 The shah symbol III(x). 
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in this case; indeed, even more may be needed because we have to deal with an 
infinite number of infinite discontinuities and a nonconvergent infinite integral. 
For example, all the conditions for existence of a Fourier transform are violated. 
The conception of an infinite sequence of impulses proves, however, to be ex¬ 
tremely useful—and easy to manipulate algebraically. 

To describe this conception we introduce the shah 2 symbol III(a) and write 

III(*)= i 8{x-n). 

n — oo 

Various obvious properties may be pointed out: 

III(-a) = 111(a) 

III(a + n) = III(a) n integral 

III(x - 5) = IH(x + i) 

f n 

III(a) dx — 1 

J »|-1 

111(a) = 0 A * n. 

Evidently, III(a) is periodic with unit period. 

A periodic sampling property follows as a generalization of the sifting inte¬ 
gral already discussed in connection with the impulse symbol. Thus multiplica¬ 
tion of a function /(a) by III(a) effectively samples it at unit intervals: 

IHM/(*)= £ /(»)«(*-n). 

n “ - x- 

The information about /(a) in the intervals between integers where III(.v) = 0 is 
not contained in the product; however, the values of f(x) at integral values of x 
are preserved (see Fig. 5.5). 

The sampling property makes 111 (a) a valued tool in the study of a wide va¬ 
riety of subjects (for example, the radiation patterns of antenna arrays, the dif¬ 
fraction patterns of gratings, raster scanning in television and radar, pulse mod¬ 
ulation, data sampling, Fourier series, and computing at discrete tabular intervals). 

Just as important as the sampling property under multiplication is a replicat¬ 
ing property exhibited when III(a) enters into convolution with a function /(a). 
Thus 


“The symbol III is pronounced shah after the Cyrillic character 111, which is said to have been modeled 
on the Hebrew letter (shin), which in turn may derive from the Egyptian J ^ | Q a hiero¬ 


glyph depicting papyrus plants along the Nile 
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IIIM/W 


Fig. 5.5 The sampling property of III(x). 


III(x) * f(x) = X f(x-n); 

n = - oo 

as shown in Fig. 5.6, the function /(x) appears in replica at unit intervals of x ad 
infinitum in both directions. Of course, if /(x) spreads over a base more than one 
unit wide, there is overlapping. 

The III symbol is thus also applicable wherever there are periodic structures. 
This twofold character is not accidental, but is connected with the fact that III is 
its own Fourier transform (in the limit), which of course makes it twice as useful 
as it otherwise would have been. 

The self-reciprocal property under the Fourier transformation is derived later. 

When a shah function is squeezed in the x-direction by a factor 2, the result 
being written III(2x), the impulses are packed twice as closely. But for algebraic 
consistency the impulses are reduced in strength by the same factor. One can un¬ 
derstand this in terms of the sequence of rectangle functions defining each im¬ 
pulse; each rectangle is squeezed to half the width and half the area. Therefore, 
just as 8{ax) = |fl| _1 6(x) (|a| appears in case a < 0), so 

This is a known trap for students and may be restated as follows. If III(x) is 
stretched so that the impulse spacing changes from unity to X, then III(x/X) rep¬ 
resents impulses at spacing X but they are no longer of unit strength X. The ex¬ 
pression for unit impulses spaced X is X _1 III(x/X). 




Fig. 5.6 The replicating property of IIIOc). 
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THE EVEN AND ODD IMPULSE PAIRS n(x) and U(x) 

Figure 5.7 shows the often-needed impulse-pair symbols defined by 

»(*) = z 5 (* + 2) + - 2)/ 

i|(x) - + ^) - |5(x - \). 

The impulse pairs derive importance from their transform relationship to the 
cosine and sine functions. Thus 

11 (x) D cos its cos 7 tx D ii(s) 

*i(jc) D i sin tts sin7rx D i h(s). 

When convolved with a function f(x), the even impulse pair ii(jc) has a du¬ 
plicating property. Thus, as illustrated in Fig. 5.8, 

..(*) * f(x) = lf{x + l) + lf(x - I). 

There are occasions when ii(x) might better consist of two unit impulses, but 
as defined it is normalized to unit area; that is, 

f OO 

11 (x)dx = 1, 

J -00 


which has advantages. 

If the finite difference of/(*) is defined by 


A/(x) = f{x + 1) - f(x - 1), 


then 


A/(x) = 2 ii(x) * f{x). 



Fig. 5.7 The even and odd impulse pairs, n(x) and ij(x). 
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H (*)*/(*) 



x 

Fig. 5.8 The convolution of n(x) with fix). 


Thus the finite difference operator can be expressed as 

A = 2 i| * 


DERIVATIVES OF THE IMPULSE SYMBOL 


The first derivative of the impulse symbol is defined symbolically by 

«'M = £«(*). 

The mental picture that accompanies this conception is the same as that involved 
in the conception of an infinitesimal dipole in electrostatics, and it is well known 
that the idea of an infinitesimal dipole is convenient and easy to think with phys¬ 
ically. The S'(x) notation carries this facility over into mathematical form, but, of 
course, there are difficulties because we cannot ask a function to go positively in¬ 
finite just to the left of the origin and negatively infinite just to the right, and to 
be zero where |x| > 0. To cap this we would wish to write 6'(0) = 0. 

For rigorous interpretation of statements involving S'(x) we may fall back on 
sequences of pulses such as were invoked in connection with 5 (jc), and consider 
their derivatives (two examples are given in Fig. 5.9). Then statements such as 

[' 8'(x)dx = 0 

J -oo 


are deemed to be shorthand for statements such as 


lim 

T —>0 



2tx 


7 T{? + T 2 ) 2 


dx 


0 , 
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Fig. 5.9 Pulse sequences (above) and their derivatives (below) which, as r —> 0, are 
used for contemplating the meaning of 8(r) and 5'(x). 

where the quantity in brackets is the derivative of one of the pulse shapes con¬ 
sidered previously in discussing 8(x). The precise form of pulse adopted is unim¬ 
portant—even a rectangular one will do—but in later work the possibility that a 
differentiable pulse shape may offer an advantage should be considered. 

A derivative-sifting property 

f OO 

8' * / = 8'(x - x')f{x')dx' = /'(*) 

J -oo 

may be established in this way. Further properties are 
( x S'(x ) dx = — 1 

J -oo 

[ I8'(x) | dx = oo 

J “OO 

x 2 S'(x) = 0 

5'(~ x ) = “«'(*) x 8'(x) = -8(x) 

/(x)5'(x) = /(0)5'(x)=/'(0)8(x). 
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The following relations apply to derivatives of higher order. 

f' 8"(x)dx = 0 

J -oo 

S"(x) * f{x) = f"(x) 

I " X 2 8"(x) dx = 2 

J "OC 

x n 8 (H \x) = (-l)"n\x" 8{x) 
& n \x) * f(x) = f n) (x) 
j™ 8 (n) (*)/(*) dx = (-1)7 ( ">(0) 


NULL FUNCTIONS 


Null functions are known chiefly for having Fourier transforms which are zero, 
while not themselves being identically zero. By definition,/(x) is a null function if 

!*/(*)<**=o 

for all a and b. An alternative statement is 

[“ l/WI dx = 0. 

J -oo 


Null functions arise in connection with the one-to-one relationship between a func¬ 
tion and its transform, a relationship defined by Lerch's theorem, which states 
that if two functions/(x) and g(x) have the same transform, then f(x) — g(x) is a 
null function. 

An example of a null function (see Fig. 5.10) is 6°(x), an ordinary single-val¬ 
ued function defined by 


S p (x) 



x * 0 
x = 0, 


which thus has a discontinuity at x = 0 similar in a way to that possessed by H(x) 
[defined so that H(Q) = \]. Under the ordinary rules of integration, the integral 
of S°(*) is certainly zero. However, it aptly describes the current taken by a series 
combination of a resistance and a capacitance from a battery, in the limit as the 
capacitance approaches zero. 

We can now more succinctly state the relation between H(x) and the step func¬ 
tion H(x) of Fig. 4.14; thus 

H(x) = H(x) + i6 n (x), 

the difference between the two being a null function. 
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Fig. 5.10 Sequences (below) defining 6'(x), and x 6(x) (above). 
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SOME FUNCTIONS IN TWO AND MORE DIMENSIONS 


One encounters the two- and three-dimensional impulse symbols 2 8{x,y), 3 6(x,y,z), 
as natural generalizations of S(x). For example, 2 S(x,y) describes the pressure dis¬ 
tribution over the (x,y)-plane when a concentrated unit force is applied at the ori¬ 
gin; *8(x,y,z) describes the charge density in a volume containing a unit charge at 
the point (0,0,0). In establishing properties of 2 8(x,y) one considers a sequence, as 
r —>■ 0, of functions such as T' 2 n(x/T)n(y/r) or (4/7r)r“ 2 n[(x 2 + y^/r], which 
have unit volume (Fig. 5.11). Then we have 


2 S(x,y) = 

I f 2 S(*,y) dx dy = 

J —oo J -oc 



X 2 + y 2 * 0 
x 2 + y 2 = 0/ 


2 8(ax,by ) = 2 8{x,y), 


and the very interesting relation 

2 «(x,y) = «(*) %). 

Introducing the radial coordinate r such that r 2 = x 2 + y 2 , we can express 2 8(x,y) 
in terms of 8(r): 


2 8(x,y) = 


8(r) 

7r|r|‘ 


In three dimensions. 


3 S(x,y,z) = 




’ 8(x,y,z) dx dy dz = 1, 


x 2 + y 2 + z 2 * 0 
x 2 + y 2 + z 2 = 0, 



functions a,b,c. 
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and ~8{x,y, 2 ) = 8(x ) S(j/) S(z) = 2 8(x,t/) 6(z). 

In cylindrical coordinates r 2 = x 2 + y 2 , 

-x _ 5 ( r )5(z) 


3 8(x,y,z) = 


*\r\ ' 


and with p 2 = x 2 + y 2 + z 2 . 


3 5(^,z) = -3 


For describing arrays in two dimensions we have the bed-of-nails symbol 
2 III(x,i/), illustrated in Fig. 5.12 and defined by 


2 III(x,y) = 2 2 2 8{x-m,y-n). 


m —oc 11 = -00 


Figure 5.13 shows an approach to the discussion of its properties. It has the prop¬ 
erty 

2 III(jr,t/) = III(x) III(y) 

and various extensions of the integral properties of 2 8(>:,y) and III(x), for example, 
f [ f(x,y) 2 IlI(x,t/) dx dy = X 2 

J -00 J 00 m n 

It is doubly periodic, 

2 III(x + m, y + n) = : III(x,y) m,n integral. 


ky\ \x y) 



Fig. 5.12 The bed-of-nails symbol, 2 III(x,i/). 
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Fig. 5.13 Two functions whose product is suitable for discussing 2 III(x,y). 


represents a doubly periodic array of two-dimensional unit impulses with period 
X in the x direction and Y in the y direction. 

Tabulation at discrete intervals of two independent variables (two- 
dimensionally sampled data), and the coefficients of double Fourier series are han¬ 
dled through the relation 

f{x,y) 2 III(x,y) = X X 2g (* ~ m >y ~ «)■ 

m n 


Convolution with 2 III(x,y) describes replication in two dimensions, such as 
one has in a two-dimensional array of identical antennas, and, as with III in one 
dimension, 2 I11 has the distinction of being its own two-dimensional Fourier trans¬ 
form (in the limit). 

The scheme of multidimensional notation introduced here permits various 
self-explanatory extensions which are occasionally useful for compactness. Thus 


3 III(x,y,z) = III(x)III(y)III(z) 
2 n(*,y) = n(x)n(y) 

sin ttx sin Try 


2 sinc (x,y) = 


TT 2 xy 


2 n(x,y) = n(x)n(y). 


Two other important two-dimensional distributions do not need new sym¬ 
bols. The row of spikes (see Fig. 5.14) is adequately expressed by III(x) S(y) and 
the grating by Ill(x). These two distributions form a two-dimensional Fourier 
transform pair and are suitable for discussing phenomena such as the diffraction 
of light by a row of pinholes or by a diffraction grating. 

These two- and three-dimensional examples have further interpretations 
when derivatives of impulses are invoked, many of them familiar as line or sheet 
distributions of electric charge. For example, 6'(x) represents a line distribution 
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of electric dipole moment confined to the i/-axis on the (.v, t/)-plane. Interpreted 
in three-dimensional space, 8'{x ) represents a sheet distribution of electric dipole 
moment on the (i/, z)-plane A simple dipole at (0, 0, 0) with unit moment in the 
x-direction is representable as — S'(*)8(y)fi(z). Quadrupole moment distributions 
are similarly expressible in terms of 5"(x). A simple unit quadrupole at (0, 0, 0), 
formed as the negative derivative with regard to x, is 6''(x)6(i/)S(z). The negative 
derivative with respect to 1 / produces a second kind of quadrupole. For example, 
S'(x)S'(y) represents an electromagnetic radiator with a quatrefoil, or clover-leaf, 
radiation pattern in the (x, i/)-plane. All these symbolic expressions may confi¬ 
dently be inserted into Maxwell's equations, the wave equation, Poisson's equa¬ 
tion, and other fundamental differential equations. 


THE CONCEPT OF GENERALIZED FUNCTION 

As has been seen, a good deal of convenience attends the use of the impulse sym¬ 
bol S(x) and other combinations of impulses such as III(x) and u(x). The word 
"symbol" has been used to call attention to the fact that these entities are not func¬ 
tions, but despite their apparent lack of status they have many uses, one of which 
is to provide derivatives for functions with simple discontinuities. Ordinarily we 
would say in such cases that the derivative does not exist, but the impulse sym¬ 
bol permits simple discontinuities to be accommodated. 

The importance of dealing with discontinuous and impulsive behavior, even 
though it is nonphysical, was explained earlier in connection with the indispens¬ 
able but nonphysical pure alternating and pure direct current. 

Pure alternating current means an eternal harmonic variation, which cannot 
be generated. However, the response to a variation that is simple harmonic over 
a certain interval and zero outside that range can be made independent of the 
time of switching on, to a given precision, by waiting more than a certain length 
of time before observing the response. Since the details of time and manner of 
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switching on are irrelevant, they might as well be relegated to the infinitely re¬ 
mote past, thus making it convenient to refer to the observable response as the 
response to pure alternating current. 

Impulses are likewise impossible to generate physically, but the responses to 
different sufficiently brief but finite pulses can be made indistinguishable to an 
instrument of given finite temporal resolving power. 

Since precision of measurement is known to be limited by the temporal and 
spectral resolution of the measuring instrument, the physical limitations referred 
to in the preceding paragraphs can be characterized as "finite resolution." The 
feature of finite resolving power invoked in the explanation contains the key to 
the mathematical interpretation of impulse-symbol notation: integrals containing 
the impulse symbol are to be interpreted as limits of a sequence of integrals in 
which the impulse is replaced by a sequence of unit-area rectangular pulses 
t ’n(x/r). The limit of the sequence of integrals may exist, even though the rec¬ 
tangular pulses grow without limit. 

Thus the statement 


J^«(.Y)/(r)rfr = /(0) 

is deemed to mean 

Km | , T ' ln (~)/(- r ) lix = /(°)- 

In this interpretation of the statement the integrals can exist, and the limit of the 
integrals as r —►() can exist. The physical situation to which this corresponds is a 
sequence of ever more compact stimuli producing responses which become in¬ 
distinguishable under observation to a given precision, no matter how high that 
precision is. 

A satisfactory mathematical formulation of the theory of impulses has been 
evolved along these lines and is expounded in the books of Lighthill (1958) and 
Friedman (1956). Lighthill credits Temple with simplifying the mathematical 
presentation; Temple (1953) in turn credits the Polish mathematician Mikusinski 
(1948) with introducing the presentation in terms of sequences. Schwartz's two 
volumes (1950,1951) on the theory of distributions unify "in one systematic the¬ 
ory a number of partial and special techniques proposed for the analytical inter¬ 
pretation of 'improper' or 'ideal' functions and symbolic methods" (Temple, 
1953). 

The idea of sequences was current in physical circles before 1948, however, 
going back to G S. Kirchhoff in 1882 (van der Pol, 1937). 

The introduction of rectangular pulse sequences was not meant to imply that 
other pulse shapes are not equally valid. In fact the essence of the approach is 
that the detailed pulse shape is unimportant. The advantage of rectangular pulses 
is the purely practical one of facilitating integration. However, rectangular pulses 
do not lend themselves to discussing the derivative of an impulse. For that we 
need something smoother which does not itself have an impulsive derivative. 
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Now for a general theory in which we wish to discuss derivatives of any order it 
is advantageous to have a pulse sequence such that derivatives of all orders ex¬ 
ist. Schwartz and Temple introduce pulse shapes which have all derivatives and 
furthermore are zero outside a finite range; an example mentioned earlier in this 
chapter is 

\x\<t 

|P \X\ > T. 

In actual fact one never inserts such a function explicitly into an integral; when 
it becomes necessary to integrate, a pulse shape with a sufficient number of de¬ 
rivatives is chosen. Often a rectangular pulse suffices. 

Particularly well-behaved functions. The term "generalized function" may 
be defined as follows. First we consider the class S of functions which possess de¬ 
rivatives of all orders at all points and which, together with all the derivatives, 
die off at least as rapidly as |x| _N as |x| — too, no matter how large N may be. We 
shall refer to members of the class S as particularly well-behaved functions. We 
note that the derivative and the Fourier transform of a particularly well-behaved 
function are also particularly well behaved. To prove the second of these state¬ 
ments let 


F(s) = [ X F{x)e- ,2 ™dx. 

J -oo 

The conditions met by the particularly well-behaved function more than suffice 
to ensure that the Fourier integral exists. Differentiating p times, we have 

pi’Xs) = f' U-i27TxYF(x)y l2 ™dx, 

) -oc 

and integrating by parts N times, we have 

(2 Try-" foe 

^ |S| N J-oo 

= 0(|sr N ); 

hence F(s) belongs to S. 

Regular sequences. Among sequences of particularly well-behaved functions 
we distinguish sequences p 7 {x) which lead to limits when multiplied by any other 
particularly well-behaved function F(x) and integrated. Thus if 

Jim f°° Pr(x)F(x)dx 

r—»u ) -oo 

exists, then we call p T (x) a regular sequence of particularly well-behaved functions. 


\dx' 


N 


[* p F(*)] 


dx 


If^MI = 
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Fig. 5.15 Sequences of particularly well-behaved functions: (a) not regular; (b) 
regular; (c) exercise. 


A sequence of particularly well-behaved functions which is not regular (see 
Fig. 5.15) is 

t 

An example of a regular sequence is 

In this example each member of the sequence has unit area, but that is not es¬ 
sential; for instance, consider the regular sequence (1 + t _1 ) exp (— x 2 /r 2 ). 

Generalized functions. A generalized function p(x) is then taken to be defined 
by a regular sequence p T (x) of particularly well-behaved functions. In fact the gen¬ 
eralized function is the regular sequence, and since the limit to which a regular 
sequence leads can be the same for more than one sequence, a generalized func¬ 
tion is finally defined as the class of all regular sequences of particularly well-be¬ 
haved functions equivalent to a given regular sequence. The symbol p(x) thus rep¬ 
resents an entity rather different from an ordinary function. It stands for a class 
of functions and is itself not a function. Therefore, when we write it in a context 
where ordinary functions are customary, the meaning to be assigned must be 
stated. For example, we shall deem that 

f V p(x)F{x)dx, 

J -oo 

where p(x) is a generalized function and F(x) is any particularly well-behaved 
function, shall mean 

lim Pt(x)F(x) Ax, 

T —) —OO 

where p r (x ) is any regular sequence of particularly well-behaved functions defin¬ 
ing p(x). 

Two points may be noticed First, the sequences r~ t n(x/r) and r -1 A(x/r) do 
not define a generalized function in the present sense, for the members of these 
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sequences do not possess derivatives of all orders at all points. Second, the func¬ 
tion F(x) on which the limiting process is tested has to be particularly well-behaved. 

These highly restrictive conditions enable one to make a logical development 
at the cost of appearing to exclude the simple sequences and simple functions we 
ordinarily handle. We must bear in mind, however, that where differentiability is 
not in question we may fall back on rectangular pulses, and that where only first 
or second derivatives are required, n * 2 and n * 1 suffice. The requirement on as¬ 
ymptotic behavior is met by the rectangular pulse. On the other hand, the se¬ 
quence r _! sine (x/r), which satisfies the requirement on differentiability, does not 
die away quickly enough to be a regular sequence in the strict sense; neverthe¬ 
less, it is usable when it enters into a product with a function which is zero out¬ 
side a finite interval. 

The advantage of the Gaussian pulse as a special but simple case of a partic¬ 
ularly well-behaved function has been exploited systematically by Lighthill (1958), 
whose line of development is followed. 

The sequence exp (—r 2 * 2 ) defines a generalized function I(x), for 

lim | e'" rr ‘ F(x) dx = j F(x)dx, 

which integral exists. Hence we can make the following statement about /(*): 

l(x)F(x) dx = ( F(x) dx, 

J -oo J — oo 

where F(x) is any particularly well-behaved function. 

The sequence t 1 exp (~7tx 2 /t 2 ) defines a generalized function, for 

lim [ X T~ x e~ 7,xi/l3 F(x)dx 

T _0 J -OO V ' 

exists and is equal to F(0), where F(x) is any particularly well-behaved function. 
To prove this note that 

f" r~V n ** fT *F(x)dx - F(0)| = f X r 'e nx2/r *[F(x) - F(0)]dx 

J -oo J -<x 

=£ max |F'(x)| f°° r 1 e nxl/rl \x\ dx 

J -oo 

= — max iF'(ar)|, 

7T 

which approaches zero as r —> 0. The generalized function defined by this and 
equivalent sequences is called 5(^r), and we can state immediately that 

\\d(x)F(x)dx = F(0), 

where F(.t) is any particularly well-behaved function. 

Algebra of generalized functions. We have introduced one rule for handling the 
symbol standing for a generalized function, namely, a rule giving the meaning of 
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[ P(x)F(x) dx. 

J -oo 

Further rules are needed for handling the symbols for generalized functions where 
they appear in other algebraic situations. 

Let p(x) and q(x) be two generalized functions, defined by the regular se¬ 
quences p T (x) and q T (x), respectively. Now consider the sequence p T (x) + q T (x). 
First, we note that it is a sequence of particularly well-behaved functions. Next, 
we see whether the sequence is a regular one, that is, whether 

[+ q r {x)]F(x)dx 

exists, where F(x) belongs to S. The integral splits into two terms, each of which 
has a limit, since p T (x) and q T (x) are by definition regular sequences. The sum of 
the two limits is the limit whose existence thus establishes that p r (x) + q r (x) is a 
regular sequence that consequently defines a generalized function. This general¬ 
ized function we would wish to assign as the denotation of 

p(x) + q(x); 

it remains only to verify that the result is the same irrespective of the choice of 
the defining sequences p T (x) and q r (x), and indeed we see that the defining se¬ 
quences p r (x) + q T (x) are equivalent, since the sum of the two limits is indepen¬ 
dent of the choice of p r (x ) and q T (x). 

We now have a meaning for the addition of generalized functions. 

Let p(x) be a generalized function defined by a sequence p T (jt). From the for¬ 
mula for integration by parts, 

f°° p'r( x )F(x)dx = - [°° p T (x)F'(x)dx, 

J -oo J — oo 

where F(x) is any particularly well-behaved function and so therefore is F'(x). 
Since F'(x) is a particularly well-behaved function, and since p T (x) is by definition 
a regular sequence, it follows that 

-Km f°° Pr(x)F’{x)dx 

T —*0 J -OO 

exists, hence 

Km f ” p' r (x)F(x) dx 

r —»0 J -oo 

exists. Thus p' T (x) is a regular sequence of particularly well-behaved functions, 
and all such sequences are equivalent. To the generalized function so defined we 
assign the notation 

p'(x). 

This gives us a meaning for the derivative of a generalized function. Here is an 
example of a statement which can be made about the derivative p'(x) of a gener- 
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alized function p{x): 

f°° p'(x)F(x)dx= -f " p(x)F'(x) dx. 

J -OO J -CO 

Similarly, j p^ n \x)F(x) dx = (-1)" J p(x)P"\x) dx. 

Since by definition F*"\x) exists, however large rt may be, it follows that we have 
an interpretation for the nth derivative of a generalized function, for any n. 

Differentiation of ordinary functions. Generalized functions possess deriva¬ 
tives of all orders, and if an ordinary function could be regarded as a generalized 
function, then there would be a satisfactory basis for formulas such as 

£ [HM] = «(*). 

If f(x) is an ordinary function and we form a sequence / r (x) such that 
lim [' f 7 {x)F{x) dx = f K f(x)F(x)dx, 

T—»0 J 'OO J OO 

where F(x) is any particularly well-behaved function, then the sequence defines 
a generalized function, which we may denote by the same symbol f(x). The sym¬ 
bol f(x) then has two meanings. We shall limit attention to functions/(x) which 
as |x| — >oo behave as |x| -N for some value of N. 

A suitable sequence / T (x) is given by 

[r * [f{x)e~ Tx1 ]- 

With this enlargement of the notion of generalized functions we can embrace 
the unit step function H(x) as a generalized function and assign meaning to its 
derivative H'(x). Thus 

f oo Too 

H'(x)F{x)dx = - H(x)F'(x) dx 

J -OO J -OO 

f 00 

= -J 0 F'(x)dx 

= [°F'(x)rfx 

Joe 

= F(0), 

but [ S(x)F(x) dx = F(0), 

J -OO 

hence H'(x) = S(x). 

The generalized function 8(x) is thus the derivative of the generalized function 
H(x), and this is how we interpret formulas such as H'(x) = S(x); we take the sym¬ 
bol for an ordinary function such as H(x) to stand for the corresponding general¬ 
ized function. 
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PROBLEMS 


1 . What is the even part of 

8{x + 3) + 8(x + 2) - 6(x + 1) + ^(x) + fi(x - 1) - 6(x - 2) - 5(x - 3)? 


2. Attempting to clarify the meaning of 5(xy), a student gave the following explanation. 
"Where u is zero, 8(u) is infinite. Now xy is zero where x = 0 and where y = 0; there¬ 
fore S(xy) is infinite along the x and y axes. Hence 8(xy) = 6(x) + 5(y)." Explain the fal¬ 
lacy in this argument, and show that 


*(*y) = 


g(*) + g (y) 

(** + />'• 


3. Show that 

i'M = 8(2x* - i) 

and that ^(x 2 - a 2 ) = i|a| '{5(x - a) + 5(x -I- a)}. [> 

4. Show that 

f' e' 2nxs ds = 8(x) 

J -oo 

and that 

[ X 8(xy 2ns * dx = 1. 

J -OO 

5. Show that 

«t«+»).3f8(x + i), a*0. 


6 . If f(x) = 0 has roots x„, show that 
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Sl/W1 = ? ITwT 

wherever exists and is not zero. Consider the ideas suggested by ^(x 1 ) and 

5(sgn x). 


7. Show that 


7 t 6 ( sin 77 j:) = III(jc) 


and 

S(sinx) = 7 t 

8 . Show' that 


III(x) 4- Ul(x - ' 

= 2 III(Zt) 

9. Show that 


n| w n (g) 

| = ni(x)n 

and also that 


| = ni(x)n 


x\ . n(*/8) 


© 


8 


10. Can the following equation be correct? 

x8{x - y) = y 8{x - y). 

11. Show that A(x) * Z \ n„ 8(x - h) is the polygon through the points 

12. Prove that 

8'(~x) = -8'(x) 
x 8’(x) — -6(x). 

Show also that 

f(x)8'(x) = f(0)8'(x)~ f'(0)8(x), 
for example, by differentiating /(x) 5(x). f> 

13. In attempting to show that 8’(x) = — 5(x)/x a student presented the following argu¬ 
ment. "A suitable sequence, as t approaches zero, for defining 8(x) is r/^x 2 + t 2 ). 
Therefore a suitable sequence for 8'(x) is the derivative 

dr — 2 tx 

dx w(x 2 + t 2 ) ir(x 2 + t 2 ) 2 

—2x _r_ 

X 2 + t z 7r(x 2 + t 2 ) 

The second factor is the sequence for 8(x), and the first factor goes to -2/x in the limit 
as r approaches zero. Therefore 6'(x) = -25(x)/x." Explain the fallacy in this argument. 
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x n $ n) (x) = (-l) n n!5(x) 


and hence that x 2 S"(x) = 2S(x) 

and x 3 S"(x) = 0. 

15. The function [x] is here defined as the mean of the greatest integer less than x and the 
greatest integer less than or equal to x. Show that 

M' = MM 

and also that ^ {[x]H(x)} = III(x)H(x) - j6(x). 

(The common definition of[x] as the greatest integer less than x is not fully suitable for 
the needs of this exercise, the two definitions differ by the null function which is equal 
to | for integral values of x and is zero elsewhere.) 

16. The sawtooth function Srt(x) is defined by Sa(x) = [x] - x + j. Show that 

Sfl'(x) = IIl(x) - 1 

and that [Sn(x)H(x)] 

17. Show that sgn 2 x = 1 - 5°(x). 

18. The Kronecker delta is defined by 

«.,= 

Show that it may be expressed as a null function of i - j as follows: 

S„ = 5°(f - j). 

19. We wish to consider the suitability of a sequence of asymmetrical profiles, such as 
r ! {A(x/t) + ^A[(x - t)/t]}, for representing the impulse symbol. Discuss the sifting 
property that leads to a result of the form 

s °*f = + pS */, 

where 8 a is a symbol based on the asymmetrical sequence, 5+ is based on the sequence 
r _, I l[(x - jt)/t], and 5. is based on the sequence r 'n[(x + \t)/t ] (r positive). t> 

20. Prove the relation 2 5(x,y) = 5(r)/7r|r|. 

21 . Illustrate on an isometric projection the meaning you would assign to Ill[(x 2 + y 2 )*]. 
How would you express something which on this diagram would have the appearance 
of equally spaced concentric rings of equal height? 


= [IH(x) - l]H(x). 


ri i = j 
\0 i * j- 
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22. The function /,(x) is formed from/(x) by reversing it; that is, /,(x) = /(-x). Show that 
the operation of forming /, from f can be expressed with the aid of the impulse symbol 
by 

/ * 8 

and hence that (/ * 5) * 5 = /. 

23. Under what conditions could we say that (f * 8) * 8 = f * (8 * 8)? 

24. All the sequences /(x,r) given on page 76 have the property that /(0,r) increases with¬ 
out limit as r—>0. Show that \r 'A[(x/r) - 1] + 2 T~‘A[(x/t) + 1] is an equivalent 
sequence which, however, possesses a limit of zero, as r—>0, for all x. Show that 
/(0 ,t), far from needing to approach oo as r —> 0, may indeed approach -oo. C> 

25. Show that 

/(x)S"(x) = /(0)5"(x) - 2/’(0) 8'(x) + /"(0)fi(x) 
and that in general 

/(x) + &”\x) = /(0) &\x) - (”)/-( 0 ) + ... 

- („ ! 3 )/ C "“' , (0)S , (x) + f {n) (0)8(x). > 

26. Impulses and sequences. The delta function possesses a "sifting property" 

L = l“5 L /( X ) ,! ( X ' T ) dx = /(°)' 

which arises from physical situations where the function h(x,r) can be thought of as a 
sequence of functions of x generated as a parameter r ranges through a series of di¬ 
minishing constant values. 

(a) Give an example of a function h(x,r) for which thp sifting property does not hold. 

(b) What conditions are sufficient for h(x,r) to meet in order for the sifting property 
to be true? 

(c) 1. Write down a particular case of h(x,r) that meets your conditions. 

2. Using your /i(x,t), take 



Does the sifting property hold true for this example? 

( d ) A particular h(x,r) has the property' that, if attention is fixed on a given value of x, 
then lim b(x,r) = 0, and the same applies for nil values of x. Could such a function 
/i(x,t) satisfy the sifting property? 

(e) Give an /i(x,t) such that L becomes/(2). 

(/) Give an /i(x,t) such that L becomes /'(0). 

(g) Give an Ii(x,t) such that L = f* f(x)dx. 

oc 

(h) Give an /i(x,t) such that L = 2 /(«) (n integral). 

n =0 
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27. Limits. A linear time-invariant system having an impulse response /(f) is excited by an 
input voltage V^(t,r), where 

V,(f,T) = [1 + t“ 2 (1 - 2r)|x|]n 


and 

l produces a response V 2 {t,r). 

(«) 

Is it 

true 

that 

lim V 2 (t, t) = /(f)? 

(b) 

Is it 

true 

that 

lim V,(f,T) = 0? 

(c) 

Is it 

true 

that 


(d) 

Is it 

true 

that 

[ X lim V,(t,r) dt = 0? 

J --OC 7->0 


28. Sequence defining S(x). Construct a sequence of particularly well-behaved functions 
/(x,r) that defines S(x) but has the property that lim f(x,r) — 0 for all x. 

29. Generalized functions. Consider the sequence of functions r 1 cos(7rx 2 /4T 2 ) generated 
as r -» 0. For all values of x, the function value diverges in an oscillatory manner with¬ 
out limit. Could such a sequence exhibit the sifting property of an impulse at x - 0; that 
is, could it be true that 

lisa \Zo T ~' cos (i ?) F{x) dx = F(0)? 

30. Asymmetrical impulse. Show that 6 + (x) introduced in Problem 5.19 differs from 8(x) 
by the derivative of a null function (p. 87) 

s,(x)- «(*) - 

31. Energy of voltage impulse. A voltage V(t) = A8(l) is applied to a resistance R. 

(«) How much charge is passed through the resistor? 

(b) How much energy is dissipated in the resistor? 

32. Delta notation. A voltage V(f) is applied to a resistance R for a finite length of time dur¬ 
ing which 2 joules of energy are transferred to the resistor. If the experiment is repeat¬ 
ed with a stronger voltage for a shorter time, too short a time, in fact, to be of interest, 
how could V(t) be written in 8 notation? t> 

33. Product of delta symbols. No definition is given to a product of impulses in the one¬ 
dimensional theory, but in two dimensions products arise naturally and are readily 
interpretable. Consider 6(x) 6(y), each factor being regarded as a function of two vari¬ 
ables and describing straight blades of unit height on the (x,y) plane (p. 335). (Unit 
height means unit line density or unit double integral per unit arc length.) Evaluate 
J x x 8(x) 8(y) dxdy by (1) substituting r _, n (x/t) for 8(x) and t‘T 1 (y/r) for 6(y) in 
accordance with the rule of p. 76, (2) performing the integration, and (3) proceeding to 
the limit as t —>0. Also show that when two blades intersect at an angle 8, the double 
integral is increased by a factor l/sinfl. C> 
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34. Autocorrelation of ring impulse. A circular ring impulse of total strength lira, de¬ 
scribed by 8(r - a), arises in optics in dealing with annular slits and also comes up in 
other fields. Show that 

S( r -«).*«(,-„) = (^) ‘ [i - (^)T* n (^). 

Graph this function of r and explain the principal features. For example, why does the 
autocorrelation become infinite at r = 0 and r = a, why are these singularities unequal; 
why is the value exactly 2 at r/2a = 2“^? Investigate the autocorrelation of 
Il(r/21) - FI(r/19). What are the values at r = 0; r = 20; what is the minimum value; 
and at what value of r does it occur? (In this problem * * stands for two-dimensional 
autocorrelation.) 

35. Delta notation. As an exercise in delta function notation, evaluate the following inte¬ 
grals. 

| 5(sin x)n(* - \)dx, j 8(cos dx, j S(sin2x)n^^ dx. \> 

36. Integral of impulse. If f™ x 8(x) dx is agreed to be unity, is there any objection to 

37. Two variables. Use the method for interpreting expressions containing delta functions 
to arrive at the meaning of delta (x, y). > 

38. Checking analysis by computer. It has been suggested that III(x) sgn x has Fourier 
transform -i cot n s. The innermost pair of impulses -5(x + 1) + 8(x - 1) has FT -2i 
sin 27T s; then transforming pair by pair suggests that 

Ou 

2) -2i sin 2 tt ks = — i cot rr s. 

k - 1 

To check for a sign error, a missing factor of 2, or more serious errors, compute both 
sides for a single value of s; for example, does sin 1° + sin 2° + sin 3° • add up to 
| cot ^°? Graph the sum of N terms versus N and discuss your finding. C> 




The Basic Theorems 


A. small number of theorems play a basic role in thinking with Fourier trans- 
forms. Most of them are familiar in one form or another, but here we collect them 
as simple mathematical properties of the Fourier transformation. Most of their de¬ 
rivations are quite simple, and their applicability to impulsive functions can read¬ 
ily be verified by consideration of sequences of rectangular or other suitable 
pulses. As a matter of interest, proofs based on the algebra of generalized func¬ 
tions as given in Chapter 5 are gathered for illustration at the end of this chapter. 

The emphasis in this chapter, however, is on illustrating the meaning of the 
theorems and gaining familiarity with them. For this purpose a stock-in-trade of 
particular transform pairs is first provided so that the meaning of each theorem 
may be shown as it is encountered. 


A FEW TRANSFORMS FOR ILLUSTRATION 

Six transform pairs for reference are listed below. They are all well known, and 
the integrals are evaluated in Chapter 7; we content ourselves at this point with 
asserting that the following integrals may be verified. 


[' e nx2 e- i2 ™ cix = e 

and I ' e ^e' n ™ds = e ^ 

J -oo 

J oc 

f OO 

f.X 

I sine Are ' 2nvs dx = FI(s) 

and n(s)e' ,2wsx ds ~ sine* 

J -oo 

J — OCI 

sine 2 Are ,2nxs dx = A(s) 

and | A(s)e' ,2nsx ds = sine 2 x 

1 -oo 

J -rx> 


Thus the transform of the Gaussian function is the same Gaussian function, 
the transform of the sine function is the unit rectangle function, and the transform 
of the sine 2 function is the triangle function of unit height and area. 


105 




106 


The Fourier Transform and Its Applications 


These formulas are illustrated as the first three transform pairs in Fig. 6.1. 
Note that the second row of the figure, which says that fl(s) is the transform of 
sine x, could be supplemented by a second figure, with left and right graphs in¬ 
terchanged, which would say that sine s is the transform of FI(x). A consequence 
of the reciprocal property of the Fourier transformation, this extra figure would 
appear redundant. However, the statement 

n(s) = [ sine x e~‘ 2nxs dx 


has quite a different character from 

sines = [ n(x)e~‘ 2lTXS dx. 

J -oo 


The first statement tells us that the integral of the product of certain rather ordi¬ 
nary functions is equal to unity for absolute values of the constant s less than 
Whether it is equal to say 0.3 or 0.35, the value of the integral is unchanged. How¬ 
ever, if |s| exceeds the situation changes abruptly, because the integral now 
comes to nothing and continues to do so, regardless of the precise value of s. Thus 


sinir.T _ , fl 
- e~' 2 ™dx = { „ 

J -oo 7 TX (0 


M<! 


This rather curious behavior is typical of many situations where the Fourier in¬ 
tegral connects ordinary, continuous, and differentiable functions, on the one 
hand, with awkward, abrupt functions requiring piecewise definition, on the 
other. The second statement may be rewritten 


sin 7rs 
7TS 



dx. 


Here an elementary definite integral of the exponential function is equal to an 
ordinary function of the parameter s. Thus the direct and inverse transforms 
express different things. Two separate and distinct physical meanings will later 
be seen to be associated with each transform pair. 

Three further transforms required for illustrating the basic theorems are trans¬ 
form pairs in the limiting sense discussed earlier. Taking the result for the Gaus¬ 
sian function, and making a simple substitution of variables, we have 1 

c *iax? e -i2n>x fa _ | fi j 1^-nfs/af 

J - JC 

As a —► 0, the right-hand side represents a defining sequence for S(s); the left-hand 
side is the Fourier transform of what in the limit is unity. It follows that 

1 is the Fourier transform in the limit of 6(s). 


'In this formula the absolute value of a is used in order to counteract the sign reversal associated with 
the interchange of the limits of integration when a is negative. 
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The remaining two examples come from the verifiable relation 

c rnx e ~(ax? e i2nsx d x _ 

J -oo a 

whence 

is the Fourier transform in the limit of 8(s — \); 

or, splitting the left-hand side into real and imaginary parts and the right-hand 
side into even and odd parts, cos 7nr is the Fourier transform in the limit of 

] 2 8(s + {) + j 8{s - |) = il(s) 

and / sin ttx is the minus-/ Fourier transform in the limit of 

-i5(s + i) + i5(s-i)= -ii(s). 

Summarizing the examples, 

e-” 2 D 
sine* D n(s) 
sine 2 a: D A(s) 

1 D 5(s) 

COS TTX D Il(s) = ^>(s + |) + ^(s - 
sin ttx D ;i|(s) as \i8(s + j) — ^/6(s - j) 

Ii(jc) D i sin tts. 

All the transform pairs chosen for illustration has physical interpretations, 
which will be brought out later. Many properties appear among the transform 
pairs chosen for reference, including discontinuity, impulsiveness, limited extent, 
nonnegativeness, and oddness. The only examples exhibiting complex or non- 
symmetrical properties are 

and 8{x - I) D f ,wS . 


SIMILARITY THEOREM 

If fix) has the Fourier transform F(s), then f(ax) has the Fourier transform 

W‘W 

Derivation: 


| f(a*Y ,z * x> dx = —■ | / {ax)e d(ax) 
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This theorem is well known in its application to waveforms and spectra, where 
compression of the time scale corresponds to expansion of the frequency scale. 
However, as one member of the transform pair expands horizontally, the other 
not only contracts horizontally but also grows vertically in such a way as to keep 
constant the area beneath it, as shown in Fig 6.2. 

A special case of interest arises with periodic functions and impulses. As Fig. 
6.3 shows, expansion of a cosinusoid leads simply to shifts of the impulses con- 







Fig. 6.2 The effect of changes in the scale of abscissas as described by the simi¬ 
larity, or abscissa-scaling, theorem. The shaded area remains constant. 
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Fig. 6.3 Expansion of a cosinusoid and corresponding shifts in its spectrum. 


stituting the transform. This is not simply a compression of the scale of s, for that 
would entail a reduction in strength of the impulses. 

In a more symmetrical version of this theorem, 

Iff(x) has the Fourier transform F(s) then |a ' i f(ax) has the Fourier transform |£>|-'F(Fs), 
where b = a \ 

Then, as each function expands or contracts it also shrinks or grows vertically (see 
Fig. 6.4) to compensate (in such a way that the integral of its square is maintained 
constant, as will be seen later from the power theorem). 


ADDITION THEOREM 

If f(x) ami g(x) have the Fourier transforms F(s) ami G(s), respectively, then 
f(x) + g(x) has the Fourier transform F(s) + G(s). 



\y v/ 

t*- Width halved -+J 


Width doubled 

Fig. 6.4 A symmetrical version of the similarity theorem. 

Derivation: 

f°° [f{x)+s{x)y 2 ™dx= [' f{x)e i2 ™dx + f" g(x)e a ™dx 

) — oc j "' oc J -oo 

= F(s) + G(s). 

This theorem, which is illustrated by an example in Fig. 6.5, reflects the suit¬ 
ability of the Fourier transform for dealing with linear problems. A corollary is 
that af{x) has the transform flf(s), where a is a constant. 


SHIFT THEOREM 

If fix) has the Fourier transform F(s), then f{x - rt) has the Fourier transform 
e ~ 2ma *F(s). 

Derivation: 

f(x - a)e ‘ 2,rx ' dx= j ' f(x - a)e ^ x -*V <a "“d(x - a) 

= e ,2 ™F{s). 

If a given function is shifted in the positive direction by an amount a, no 
Fourier component changes in amplitude; it is therefore to be expected that the 
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Fig. 6.5 The addition theorem f + g D F + G. 


changes in its Fourier transform will be confined to phase changes. According to 
the theorem, each component is delayed in phase by an amount proportional to 
s; that is, the higher the frequency, the greater the change in phase angle. This oc¬ 
curs because the absolute shift a occupies a greater fraction of the period s 1 of a 
harmonic component in proportion to its frequency. Hence the phase delay is a/s~ x 
cycles or 27rfls radians. The constant of proportionality describing the linear change 
of phase with s is 27ra r the rate of change of phase with frequency being greater 
as the shift a is greater. 

The shift theorem is one of those which are self-evident in a chosen physical 
embodiment. Consider parallel monochromatic light falling normally on an aper¬ 
ture. To shift the diffracted beam through a small angle, one changes the angle of 
incidence by that amount But this is simply a way of causing the phase of the il¬ 
lumination to change linearly across the aperture; another way is to insert a thin 
prism that injects delays proportional to the prism thickness at each point of the 
aperture. These well-understood procedures for shifting the direction of a light 
beam are shown in Chapter 13 to exemplify the shift theorem. 

In the example of Fig. 6.6, a function f(x) is shown whose transform F(s) is 
real A shifted function f(x — \) has a transform which is derivable by subjecting 
F(s) to a uniform twist of 7r/2 per unit of s. The figure attempts to show that the 
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Fig. 6.6 Shifting fix) by one quarter unit of x subjects F(s) to a uniform twist of 
90 deg per unit of s. 


plane containing F(s) has been deformed into a helicoid. The practical difficulties 
of representing a complex function of s in a three-dimensional plot are overcome 
by showing the modulus and phase of F(s) separately; however, the three- 
dimensional diagram often gives a better insight. 

The second example (see Fig. 6.7) shows familiar results for the cosine and 
sine functions and for the intermediate cases which arise as the cosine slides along 
the axis of x. In this case the helicoidal surface is not shown. An alternative rep¬ 
resentation in terms of real and imaginary parts is given, incorporating the con¬ 
vention introduced earlier of showing the imaginary part by a broken line. A small 
shift evidently leaves the real part of the transform almost intact but introduces 
an odd imaginary part. With further shift the imaginary part increases until at a 
shift of 7 t/ 2 there is no real part left. Then the real part reappears with opposite 
sign until at a shift of tt both components have undergone a full reversal of phase. 


MODULATION THEOREM 

If fix) has the Fourier transform F(s), then f(x) cos tox has the Fourier transform 
2 F(s — w/2n) + |F(s + o)/27t). 
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The new transform will be recognized as the convolution of F(s) with 
\8(s + o)/2it) + \8(s — io/2tt ) = (ir/to)ii(irs/io). This is a special case of the convo¬ 
lution theorem, but it is important enough to merit special mention. It is well 
known in radio and television, where a harmonic carrier wave is modulated by 
an envelope. The spectrum of the envelope is separated into two parts, each of 
half the original strength. These two replicas of the original are then shifted along 
the s axis by amounts ±<t)/27r, as shown in Fig. 6.8. 


CONVOLUTION THEOREM 

As stated earlier, the convolution of two functions / and g is another function h 
defined by the integral 


K*) = \ ~ ») thi. 

J -oc 

A great deal is implied by this expression. For instance, h(x) is a linear functional 
of f(x); that is, h(Xi) is a linear sum of values of /( x), duly weighted as described 
by g(x). However, it is not the most general linear functional; it is the particular 
kind for which any other value /i(x 2 ) is given by a linear combination of values 
of f(x) weighted in the same way. Another way of conveying this special property 
of convolution is to say that a shift of f(x) along the x axis results simply in an 
equal shift of h(x); that is, if h(x) = f{x) * g(x), then 

fi* ~ “) * g( x ) = Hx ~ «)• 

Suppose that a train is slowly crossing a bridge. The load at the point x is f(x), 
and the deflection at x is h(x). Since the structural members are not being pushed 
beyond the regime where stress is proportional to strain, it follows that the de¬ 
flection at X] is a duly weighted linear combination of values of the load distri¬ 
bution f{x). But as the train moves on, the deflection pattern does not move on 
with it unchanged; it is not expressible as a convolution integral. All that can be 
said in this case is that h(x) is a linear functional of f[x); that is, 

;, (*) = f( u M x ' u ) lhl 

It is the property of linearity combined with x-shift invariance which makes 
Fourier analysis so useful; as shown in Chapter 9, this is the condition that sim¬ 
ple harmonic inputs produce simple harmonic outputs with frequency unaltered. 

If the well-known and widespread advantages of Fourier analysis are con¬ 
comitant with the incidence of convolution, one may expect in the transform 
domain a simple counterpart of convolution in the function domain. This counter¬ 
part is expressed in the following theorem 
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If f(x) has the Fourier transform F(s) and g(x) has the Fourier transform G(s), then 
f(x) * g(x) has the Fourier transform F(s)G(s); that is, convolution of two functions 
means multiplication of their transforms. 


Derivation: 


f °° f(x')g(x - x') dx' 

J — oo J — oo 


~i2irxs 


dx 


= f°° /(X') [ f 00 g(x - x')e~ a ™ dx 

J -00 J -oo 

= f X f(x')e' 27TX ' s G(s) dx' 

J -oo 


dx' 


= Hs)G(s). 

Using bars to denote Fourier transforms, we can give compact statements of 
the theorem and its converse. Thus 


f *8 = fg> 

Jg = f*8- 

Equivalent statements are, using a long bar for the inverse transform. 


We have stated earlier that 


fg 

7*8 


= f*g 


= fg- 


f * 8 ~ 8 * f (commutative) 

f*(g*h) = (J*g)*h (associative) 

f * (g + h) = J * g 4- f * h (distributive). 

Further formulas are 

f *g*h = fgh, 

f * igh) =f(g* h). 

This powerful theorem and its converse play an important role in transform¬ 
ing a function which can be recognized as the convolution of two others or as the 
product of two others. 

The following are statements in words of some of the above equations. 

1. The transform of a convolution is the product of the transforms. 

2. The transform of a product is the convolution of the transforms. 

3. The convolution of two functions is the transform of the product of their trans¬ 
forms. 

4. The product of two functions is the transform of the convolution of their trans¬ 
forms. 
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Three valuable properties often used for checking are the following. 

1. The area under a convolution is equal to the product of the areas under the 
"factors"; that is. 


for 


* *) dx = [ J^/W dx ] [ d 

f(u)g(x - u) du j dx = j f{u) j g(x - u) dx 

f J f(u) du | g{x) dx 


du 


= J f(u) du 

2. The abscissas of the centers of gravity add; that is, 

<*>/•* = <*>/ + ( 4 ' 


where 



f 

xh(x) dx 

J -oo _ 

h(x) dx 

J OCi 


3. The second moments add if {x) f or (x\ = 0; in general, 

(* 2 )/‘g = ( 4 / + (A + 2(4(4, 

[ x 2 h(x) dx 

where (x\ - - 

h(x) dx 

J ”OC- 


It follows that the variances must add (p. 158). 

We have enunciated the convolution theorem in the form 


f(x) * g(x) has the Fourier transform F(s)G(s) r 
which, written in full, becomes either 

f(u)g{x - u) du = I F(s)G{s)e' ZlTXi ds 

J -oc J “OO 

or F(s)G(s) = f [ f(n)g{x ~ u)e ' 2irxs du dx. 

There are no fewer than 20 versions in which the convolution theorem is con¬ 
stantly needed, when we allow for complex conjugates and sign reversals of the 
variables. The 10 abbreviated forms are 
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f * g D FG 
/*g(-)DFG(-) 
/(-)*£(-) :> F(-)C(-) 

/ *g*(-) D FG* 

f * 8* rc*(-) 

/(-) *£*(") 3 F(-)G* 
/(-)*** DF(-)G*(-) 

/*(-) * £* D F*G*(-) 
f**g* D F*( —)G*(—) 

The self-convolution formulas are 

/ * / D F 2 

/(-)*/(-) =>[ f (-)] 2 
/*(-)*/*(-) 3 [ f *] 2 

f* *f* D [F*(-)] 2 

and for autocorrelation we have 

/*/DFF(-) 
/(-) * /(-) => FF(-) 
/*(-)★/*(-) D F*F*(—) 
/* ★ /* D f*F*(—) 


RAYLEIGH'S THEOREM 

The integral of the squared modulus of a function is equal to the integral of the 
squared modulus of its spectrum; that is, 

f" \f(x)\ 2 dx = [" |F(s)| 2 ds. 

J~OQ J ~<X 

Derivation: 

f 0 " f( x )f*(x) dx = f f{x)f*{x)e~ anx< dx 

J cX» J • JU 

= F(s') * F*(—s') 

= F(s)F*(s - s')ds 

J - oo 

= f X F(s)F*(s) ds. 

J -OC 

This theorem, which corresponds to Parseval's theorem for Fourier series, was 
first used by Rayleigh (1889) in his study of black-body radiation. In this, as in 
many other connections, each integral represents the amount of energy in a sys- 


S* = 0 
s' = 0 

s' = 0 
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tern, one integral being taken over all values of a coordinate, the other over all 
spectral components (see Fig. 6.9). 

The theorem is sometimes referred to in mathematical circles as Plancherel's 
theorem (see Titchmarsh, 1924) after M. Plancherel, who in 1910 established con¬ 
ditions under which the theorem is true. The theorem is true if both the integrals 
exist. More recently, it has been shown by Carleman (see Bibliography, Chapter 
2) that the theorem is true if one of the integrals exists. Rayleigh simply assumed 
in his derivation that the integrals existed. 


POWER THEOREM 


foe foo 

Derivation: The proof is as for Rayleigh's theorem when f* is replaced by g* 
and F* by G*. The following version illustrates a compact notation which is use¬ 
ful in its place. 

| f g * dx = Jg *\ 0 = J * £*| 0 = F * G*(~) lo = \ FC* ds. 

In many physical interpretations, each side of this equation represents energy 
or power (see Fig. 6.10), two different approaches being used to evaluate the en¬ 
ergy or power. In one approach the instantaneous or local power or energy is eval¬ 
uated as the product of a pair of canonically conjugate variables (electric and mag¬ 
netic fields, voltage and current, force and velocity) integrated over time or space. 
In the second approach the temporal or spatial spectral components are multi¬ 
plied and integrated over the whole spectrum. 
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Fig. 6.10 The power theorem: the shaded areas are equal. In this example/and g 
are real and even. 


It very often happens that both / and g are real quantities, as in the three 
examples cited. Then F and G may be complex, and 

FG* = (Re F + i Im F)(Re G-i Im G) 

= (Re F)(Re G) + (Im F)(Im G) + odd terms. 

Inspection shows that the final terms are odd, for F and G are hermitian: that is, 
their real parts are even and imaginary parts odd. The odd terms do not con¬ 
tribute to the infinite integral. Hence for real/and g 

( OO f 'X foe 

fg dx = FG* ds = [(Re F)(Re G) + (Im F)(Im G)1 ds. 

J -OC J —CXs J - oo 

This situation is illustrated in Fig. 6.11. 

Exercise. Show that, provided / and g are real, an alternative version of the 
power theorem is 

[ f(x)g(~x)dx= [ F(s)G{s)ds. 

J -OC J -9C 

By putting g(x) = f(x) we obtain Rayleigh's theorem, which is thus appro¬ 
priate to physical systems where, f/g and F/G (often interpretable as impedance 




Fig. 6.11 The power theorem for/and g real, F and G complex. The shaded area 
on the left equals the sum of the shaded areas on the right. 
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in its general sense) being constant, energy or power may be expressed as the 
square of one variable alone. The theorem does not have a distinctive name of its 
own; some authors refer to it as ParsevaTs theorem, which is the well-established 
name of a theorem in the theory of Fourier series (Chapter 10). 


AUTOCORRELATION THEOREM 

If f(x) has the Fourier transform F(s), then its autocorrelation function 

/!° k /*(w)/(h + x) du has the Fourier transform |F(s)| 2 . 

Derivation: 

f OG ^ „ foO » 

|F(s)|V 2 ™ds = F{s)F*{s)e i2rrxi ds 

J -<x J - oc 

= /(*)*/*(-*) 

= f°° /(m)/*(m - X) du 

J ~oo 

= [°° /•(«)/(« + *) du. 

A special case of the convolution theorem, the autocorrelation theorem is fa¬ 
miliar in communications in the form that the autocorrelation function of a sig¬ 
nal is the Fourier transform of its power spectrum. 2 It is illustrated in Fig. 6.12. 
The unique feature of this theorem, as contrasted with a theorem that could be 
stated for the self-convolution, is that information about the phase of F(s) is en¬ 
tirely missing from F(s)| 2 . The autocorrelation function correspondingly contains 
no information about the phase of the Fourier components of f(x), being un¬ 
changed if phases are allowed to alter, as was shown on p. 45. 

Exercise. Show that the normalized autocorrelation function -y(x), for which 
•y(O) = 1 (see p. 41), has as its Fourier transform the normalized power spectrum 
l<I>(s)| 2 whose infinite integral is unity, and which is defined by 



A statement may also be added about the function C(x), which was defined 
in Chapter 3 by the sequence of autocorrelation functions yx(x) generated from 


2 The corresponding theorem for signals that do not tend to zero as time advances is sometimes re¬ 
ferred to as Wiener's theorem (1949). 
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Fig. 6.12 The autocorrelation theorem: autocorrelating a function corresponds to 
squaring (the modulus of) its transform. 


the functions f{x)Y[(x/X) as X — >oo. If y x (x) approached a limit, then the limit 
was called C(x). Corresponding to the sequence of normalized autocorrelation 
functions, y x (x) is the sequence of normalized power spectra <I> x (s)| 2 . If y x (x) ap¬ 
proaches a limit as the segment length X increases, then the normalized power 
spectrum settles down to a limiting form |4> oc (s)| 2 . In these circumstances the 
autocorrelation theorem takes the form 

CM 3 |<Ms)l* 

and one generally says, as before, that the autocorrelation is the Fourier transform 
of the power spectrum, suiting the definitions to the needs of the case. 

Clearly it may happen that the sequence of transforms of y x (*) does not ap¬ 
proach limits for all s but is of a character describable with impulse symbols 5(s). 
Therefore situations may be entertained where the transform of C(a) is a gener¬ 
alized function. For example, an ideal line spectrum such as is possessed by a sig¬ 
nal carrying finite power at a single frequency is such a case. We know that if 
f(x) = cos ax, then C(x) = cos ax. The Fourier transform of C(x) is thus a gener¬ 
alized function \8(s + a/2ir) + 2 (s - ajlir), and if necessary we could work out 
the sequence of transforms of y x (x) that define it. The interesting point here, how¬ 
ever, is that the power spectrum as a generalized function is not deducible from 
the autocorrelation theorem, for no interpretation has been given for products 
such as [S(x)] 2 . 

Exercise. Give an interpretation for (S(x)] 2 by attempting to apply the auto¬ 
correlation theorem to f(x) = cos ax and test it on some other simple example 
such as /(*) = 1. 
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Exercise. Show that the situation cannot arise where the sequence y x (x) calls 
for the use of S(x) in representing C(x). 

Exercise. We wish to discuss the ideal situation of a power spectrum which is 
flat and extends to infinite frequency. Determine C(x) and its transform. Show that 
the nonnormalized autocorrelation function lends itself to this requirement, and 
that a good version of the autocorrelation theorem can be devised in which the 
power spectrum is normalized so as to be equal to unity at its origin. What does 
this form of the theorem say when f{x) = cos ax? 


DERIVATIVE THEOREM 

Iff(x) has the Fourier transform F($) then f'(x) has the Fourier transform /2ttsF(s). 


Derivation: 


DO 

— ®C 


f’(x)e ,2 ” x - dx = 




f(x+^)~f(x) r n^ dx 

Ax 

+ e ~ i2irxs dx - lim f' ^ e~ anxs dx 
Ax J -oo Ax 



/ 

/ 




Fig. 6.13 Differentiation of a function incurs multiplication of the transform by 
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J 

1 

k 

Second derivative 

1 


r 




Fig. 6.14 


Successive applications of the derivative theorem. 


e’ 2nll 'F(s) - F(s) 

= lim- 

Ax 

= /27tsF(s). 

Since taking the derivative of a function multiplies its transform by i2irs, vve 
can say that differentiation enhances the higher frequencies, attenuates the lower 
frequencies, and suppresses any zero-frequency component. Examples are given 
in Figs. 6.13 and 6.14. 

It happens quite frequently that the multiplication of i2ns causes the integral 
of |/27tsF(s)| to diverge. Correspondingly, the derivative f'(x) will exhibit infinite 
discontinuities. Such situations are accommodated by the impulse symbol and its 
derivatives. 
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DERIVATIVE OF A CONVOLUTION INTEGRAL 

From the derivative theorem taken in conjunction with the convolution theorem, 
it follows that if 

h= f*g, 

then h' = f * g, 

and also h' = f * g'. 

Derivation: 

^ [/(*) * g ( x )] 3 /2tts[F(s)G(s)] 

f'(x)*g(x)D[i27rsF(s)]G(s) 
f(x)*g'(x) D F(s)[/'27rsC(s)j. 

These conclusions may be stated in a different form as follows: 

The derivative of a convolution is the convolution of either of the functions with the 
derivative of the other. 

Thus 

if *gy 

and again f * g 


= f * g = f * g'. 
= /' * ( gdx 

= f" * \ | X gdxdx 


Exercise. Investigate the question of what lower limits are appropriate for the 
integrals. Investigate the formula f'*g = f*g' by integration by parts. 

In terms of the derivative of the impulse symbol we may write 

h = 8 * h. 

Therefore h' = 8' * h = 8' * f * g — (S' * f) * g = f'*g 

= f * (S' * g) = f * g', 

f * g = 8 * f * g = (8' * H) * f * g = (8' * f) * (H * g). 

The formulas quoted here are applicable to the evaluation of particular con¬ 
volution integrals analytically or numerically but are principally of theoretical 
value (for example, in the deduction of the uncertainty relation and in deriving 
the formulas for the response of a filter in terms of its impulse and step responses). 

The convenient algebra permitted by the 8 notation in conjunction with the 
associative and other properties of convolution enables rapid generation of rela- 
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tions which may be needed for some problem under study. Many interesting pos¬ 
sibilities arise. For example, starting from 

^ (/ * g) D i2irsFG 


we may factor the right-hand side to get 


d_ 

dx 


(f*X) 


djf djg 
dx 1 - * dx' 


D (i27rs)-'F(/27rs)-G. 


THE TRANSFORM OF A GENERALIZED FUNCTION 

Let p(x) be a generalized function defined as in Chapter 5 by the sequence p T (x). 
Let the Fourier transforms of members of the defining sequence be P T (s), where 

P T (s) = f 30 p 7 {x)e- ,2n<x dx. 

J -oo 

Perhaps this new sequence P r (s) defines a generalized function. We know that the 
members of the sequence are particularly well-behaved, we test the sequence for 
regularity by means of an arbitrary particularly well-behaved function F(.v) whose 
Fourier transform is F(s). From the energy theorem 

Pt(s)F(s) ds = f p r (x)F( — x) dx 

J -oo J -OO 

it follows that 

Jim f P r (s)F(s) ds = lim j p r (x)F(-x) dx, 

and we know the latter limit exists. Hence P T (s) defines a generalized function, 
to which we give the symbol P(s) and the meaning "Fourier transform of the gen¬ 
eralized function p(x)." 

The following statement can be made about p(x) and P(s), 

[°° P{s)F(s)ds = [' p(x)F(-x)ds, 

J ~oo J — oc 

where F(x) is any parhcularly well-behaved function and F(s) is its Fourier trans¬ 
form. 

Let <f)(x) be a function, such as a polynomial, that has derivatives of all orders 
at all points but whose behavior as |.r| —> oo is not so stringently controlled as that 
of particularly well-behaved functions. We allow </>(*) to go infinite as |x| N where 
N is finite. Functions such as exp x and log x would be excluded. Then products 
of d>(x) and any particularly well-behaved function will eventually be over- 
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whelmed by the latter as |at| —>00, since the particularly well-behaved factor dies 
out faster than |.v| N . Furthermore, since the product has all derivatives at all 
points, the product itself is particularly well-behaved. 

Consider a sequence 

4>(x) P T (x)- 

It is particularly well-behaved, and 

lim f («K*)p r (x)]F(x) dx = lim f p 1 (x)[<f>(x)F(x)]dx, 

T—HJ J -00 T —J — OO 

which exists since p T {x) is a regular sequence and $(x)F(x)] is particularly well- 
behaved. The generalized function so defined we write as 

<t>(x)p{x). 

In practice we use this notation with functions <f>(x) that have a sufficient num¬ 
ber of derivatives and include exponentially increasing functions when, as is the 
case with the pulse sequence r _1 n(x/r), the behavior at infinity is inessential. 

Nothing is introduced which could be called the product of two generalized 
functions; the product of two defining sequences is not necessarily a regular se¬ 
quence and consequently does not in general define a generalized function. 


PROOFS OF THEOREMS 

The numerous theorems of Fourier theory, which have proved so fruitful in the 
preceding sections, have shown themselves perfectly adaptable to the insertion 
of the impulse symbol 6(x), the shah symbol III(jr), the duplicating symbol n(x), 
and other familiar nonfunctions. Standard proofs of the theorems eliminated these 
cases, and accepted conditions for the applicability of the theorems which we have 
found in practice need not be observed. This situation was dealt with above by 
introducing the idea of a transform in the limit, and special ad hoc interpretations 
as limits were placed on expressions containing impulse symbols. 

Having established the algebra for generalized functions, we can also give 
systematic proofs of the various theorems, free from the awkward conditions that 
arise when attention is confined to those functions that meet the conditions for 
existence of regular transforms. The difficulties associated with functions that do 
not have derivatives disappear, for generalized functions possess derivatives of 
all orders. And more intolerable circumstances, such as the lack of a regular spec¬ 
trum for direct current, also vanish. The brief "derivations" given above are use¬ 
ful while the theorems are being learned but do not qualify as strict proofs as pre¬ 
sented by Lighthill (1958). Some examples of proofs in terms of the sequences 
p T (x) used for defining generalized functions are given below as illustrations of 
formal proofs. 
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Similarity and shift theorems. We prove these theorems simultaneously. Let 
p(x) be a generalized function with Fourier transform P(s). Then 

p(ax + b) D ~ e , ' 2nbs/a P Q. 

Proof: Since 

‘ij r^ ax + b w dx = ]J| ¥■» 

exists, we have a meaning for p(ax + b). Now 

/>,(«* + b)D T e wp, Q 

by substitution of variables. Hence the two theorems follow. 

Derivative theorem. The Fourier transform of p’ T (x) is /27rsP T (s). Hence the 
Fourier transform of p’(x ) is i2nsP(s). 


Power theorem. Since no meaning has been assigned to the product of two 
generalized functions, the best theorem that can be proved is 

[ P(s)F(s)ds = ( p(x)F(—x) dx, 

J — oc J - <x> 

where F(x) is a particularly well-behaved function and p(x) is a generalized func¬ 
tion. The theorem follows from the fact that 

lim [ P T (s)F(s)ds = lim [ [ F(s)p(x)e~ ,2irsx dx ds 

T .0 J -oo T .0 J -00 J — oo 

= Hm f* p r (x)F(-x)dx. 

T.U J — OO 

All the above theorems generalize readily to two dimensions. Rotation and 
shear, which do not arise in one dimension, are associated with new basic theo¬ 
rems, circular symmetry introduces important special cases, and the affine theo¬ 
rem applying to functions of the form / (ax + by + c, dx + ey + f) has rich im¬ 
plications for graphics (Bracewell et al. 1993, Bracewell 1994). 


SUMMARY OF THEOREMS 

The theorems discussed in the preceding pages are collected for reference in Table 

6 . 1 . 
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Theorems for the Fourier transform 
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Theorem 

fix) 

F(s) 

Similarity 

f(ax) 

— F 

M W 

Addition 

/(*) + «(*) 

F(s) -r G(s) 

Shift 

f(x - a) 

e ,2 ”°T(s) 

Modulation 

f{x) COS MX 

K S ~2»)* ;F ( S *£) 

Convolution 

/(*) * £(*) 

F(s)G(s) 

Autocorrelation 

/(*)*/*(-*) 

|F(s)| J 

Derivative 

/'(V) 

t2rrsF(s) 

Derivative of convolution 

£[/(*)•*(*)] = 

f'(x) * *(*) = /(*) * X'W 

Rayleigh 

| . I/Ml 2 dx = 

[F(s )| 2 ds 

Power 

/(*)£*(*) iix 

= [" F(s)G*(s)ds 

J -oc 

(/ and g real) 

f f(x)g(-x)dx 

= r F(s)G(s) ds 

J 

i - X 
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PROBLEMS 

1. Using the transform pairs given for reference, deduce the further pairs listed below by 
application of the appropriate theorem. Assume that A and a are positive. 
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sin x 
x 

sinAx 

Ax 


D vl~l (vs) 
v (vs\ 

d a u {a) 


e * D v'-e'" 


e -W D ( 2 vfae 2 ” 1 ^ 


(sin x\ 2 ,, . 

D nA(vs) 

( sin AxY v . (vs\ 
Ax ) D A (a) 


6(flx) D 


l«l 


S(ax + b) D ~e i2l,is/a 

l a l 


" D <* - h) 


2. Show that the following transform pairs follow from the addition theorem, and make 
graphs. 

1 + COS -7TJC D 8(s) + Il(s) 

1 + sin vx D 6(s) + r ii(s) 
sine x + | sine 2 ^x D n(s) + A (2s) 

A~\g-' n x‘/A -j- A \ e -n Ar 1 -j g-mf/A + „ nAs 2 

4 cos 2 7 tx + 4 cos 2 { 7rx - 3 D 6(s + |) + S(s - |) + S(s) + jS(s - 1) + |5(s + 1). 


3. Deduce the following transform pairs, using the shift theorem. 

cos vx 


v(x - I) 
sin vx 


D -e' ms n(s) 
D -e' ,2,,s n(s) 


7T(x - 1) 

A(x - 1) D e a ” s sinews 
n(x - -> e sines 

n(x) sgn x D -i sin {vs sine £s 


n (i_i£) DW ^ 


sine as. 


4. Use the convolution theorem to find and graph the transforms of the following func¬ 
tions: sine x sine 2x, (sine x cos 10x) 2 . 

5. Let /(x) be a periodic function with period a, that is, f(x + a) = f(x) for all x. Since the 
Fourier transform of f(x + a) is, by the shift theorem, equal to exp (i2vas)F(s), which 
must be equal to F(s), what can be deduced about the transform of a periodic function? 

6. Graph the transform of /(x) sin <nx for large and small values of to, and explain graph¬ 
ically how, for small values of w, the transform of /(x) sin u>x is proportional to the de¬ 
rivative of the transform of f(x). O 

7. Graph the transform of exp (— x)H(x) cos a>x. Is it an even function of s? 

8. Show that a pulse signal described by fI(x/X) cos 2vfx has a spectrum 

|X{sinc [X(s + /)] + sine [X(s - /)]} 
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9. Show that a modulated pulse described by n(x/X)(l + M cos 2nFx) cos 27t/x has a 
spectrum 

|X{sinc [X(s + /)] + sine [X(s - /)]} + |MX{sinc [X(s + / + F)] 

+ sine [X(s + / - F)] + sine [X(s ~ f + F)] + sine [X(s — / — F)]}. 

Graph the spectrum to a suitably exaggerated scale for a case where there are 100 mod¬ 
ulation cycles and 100,000 radio-frequency cycles in one pulse and the modulation co¬ 
efficient M is 0.6. Show by dimensioning how the factors 100,100,000, and 0.6 enter into 
the shape of the spectrum. 


10. A function f(x) is defined by 

/M = < 


o 

2 - |*| 
1 


M > 2 

1 < |x| < 2 

1*1 < i; 


show that 

f{x) = 2A (j) - A(x) = A(x) * \S(x + 1) + 8(x) + 5(* - 1)] 


and hence that 

F(s) = 4 sine 2 2s - sine 2 s = sine 2 s(l + 2 cos 2ns). 

11. Prove that f * g * h D FGH and hence that /*" D F". 

12. The notation /*” meaning f[x) convolved with itself« — 1 times, where n = 2, 3,4,..., 
suggests the idea of fractional-order self-convolution. Show that such a generalization 
of convolution is readily made and that, for example, one reasonable expression for 
f(x) convolved with itself half a time would be 

m f e >2™[f e -*™f( U ) du y)ds.t > 

13. Prove that 

(f*g)(h*j)D(FC)*(HJ) 

and that 

(/ + g) * (h + j) D FH + FJ + GH + G). 

14. Use the convolution theorem to obtain an expression for 

e * e bx \ O 


15. Prove that 


( f*( u )g*( x ~ u)du D F*(-s)G*(—s). 

J “OC 


16. Prove that 


[ f f *(“)%*(“ ~ x ) e i2 "* s du dx = F*(-s)G*(s). 

J ~oo J ~oo 



chapter 6: The Basic Theorems 


133 


17. Show by Rayleigh's theorem that 


sine 2 x dx = 1 

J -ot 

j sine 4 x dx = J [A(x)] 2 dx = 2 

[ Uo(x)] 2 dx = oo 

J —co 

f°° dx _ 7 T 

J -cc n + x*y ~ 2 


dx _ 7T 

(i + x*y ~ 2 


18. Complete the following schemata for reference, including thumbnail sketches of the 
functions. 


transform 


autocorrelation power spectrum 
f*f D |T(s)| 2 


n (jc) cos 2-nfx 


19. Show the fallacy in the following reasoning. "The Fourier transform of f x (x f(x) dx 
must be F(s)/i2ns because the derivative of J* v f{x)dx is f(x), and hence by the de¬ 
rivative theorem the transform of f{x) would be F(s), which is true " 

20. Establish an integral theorem for the Fourier transform of the indefinite integral of a 
function. t> 

21. Use the derivative theorem to find the Fourier transform of xe ’ Tjr \ 

22. Show that 2ttxY\(x) D i sine's. 

23. The following brief derivation appears to show that the area under a derivative is zero. 
Thus 


f'(x) dx = f'(x) = i2irsF(s) = 0. 

■J 00 n n 










134 


The Fourier Transform and Its Applications 


Confirm that this is so, or find the error in reasoning. 

24. Show that 


25. Show from the energy theorem that 

I e~ 1TX ‘ cos 2 nax dx = e~"°\ 

) -oo 

26. Show from the energy theorem that 

foe _ 

sinc^ x cos 7 rxdx = 2 - 

J -oa 


27. Show that the function whose Fourier transform is |sinc s| has a triangular autocorre¬ 
lation function. 


28. As a rule, the autocorrelation function tends to be more spread out than the function it 
comes from. But show that 


1 -1 

7TX 7TJC 


= «(*)• 


Show that (t rx) 1 must have a flat energy spectrum, and from that deduce and investi¬ 
gate other functions whose autocorrelation is impulsive. > 


29. The Maclaurin series for F(s) is 

F(0) + sF'(O) + |f"(0) + .... 


Consider the case of F(s) = exp (-7rs 2 ), where the series is known to converge and to 
converge to F(s). Thus, in this particular case, 

F(s) = 2 ~ 

n - 0 ”• 

If F(s) is the transform of F(x), then transforming this equation we obtain 

f(x) = 8(x) f ' f(x) dx - s'ix) |' xf(x) dx + *-(jc) f ^ | fix) dx + .... 


How do you explain this result? C> 

30. Fourier pairs. Derive the following Fourier transform pairs: 
(a) e‘ nx> D r ,n 4 e m * ; 

{b ) cos (7rx 2 ) D 2 [cos (7rs 2 ) + sin (rrs 2 )] 
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(.c) 

(d) 

(e) 


sin (wx 2 ) D 2 -[cos (tts 2 ) - sin (tts 2 )] 

D (o2 + eXp ("?^)s°n( arC,an (a) 




Ttfis 1 \ 
a 2 + (. 3 V 


31. Frequency analysis. A volcano on the floor of the Pacific Ocean erupted near an in¬ 
habited island, causing the sea surface to rise and fall, reaching a maximum height of 
about 10 meters. The height was recorded by the captain of a vessel standing offshore, 
using a sextant to determine the distance from the water to the top of a cliff. Later ex¬ 
amination showed that the height h(t) could be represented approximately by 

h(t) = 11 sin (45° - 72°f) exp (-/ 2 /5), 

where h is in meters and t is in minutes. The volcano erupts from time to time, often 
causing damage to the docks and shipping in the lagoon, but this is the first time a 
waveform has become available and it is to be the basis of a redesign of the port. 

(a) Paying particular attention to the correctness of numerical values, but not neces¬ 
sarily carrying out all the arithmetic, obtain the Fourier transform h(J) of h(t). 

(b) At what frequency, in cycles per minute, will the excitation be at a maximum? 

32. Chirp signal. A chirp is a signal that sweeps in frequency and is used in radar by bats 
and humans to facilitate the sorting out of the emitted signal from the echo under con¬ 
ditions where the first echoes will be returning while the emission is still continuing. 
An example is 

s (f) = C + 

This chirped pulse has an equivalent duration T, a frequency / 0 at midpulse, and a fre¬ 
quency sweep rate 2/3. Show that the power spectrum is centered at /„ and has an 
equivalent width A given by A = 2 -T~'(l + 4/3 2 7 M )-. 

33. Voigt profiles. Spectral lines often have a profile of the form [1 + 4(/ - / 0 ) 2 /B 2 ] ' 
which arises, for example, from absorption by a resonator. This is a shifted Cauchy pro¬ 
file Other spectral lines may have a Gaussian profile, as in the case of a gas in a state 
of turbulence where Doppler shifts greatly exceed the natural linewidth B. Intermedi¬ 
ate profiles of the form Gaussian-convolved-with-Cauchy are known as Voigt profiles. 
They have interesting properties. Show that the convolution of two Voigt profiles is 
also a Voigt profile. > 

34. Inverse theorems. Show that the inverse derivative and inverse shift theorems are 

-i2irxf(x) D F'(s) 
i^f(x) D F(s - s 0 ). 

Are there any other theorems where the direct and inverse forms are not the same? 




Obtaining Transforms 


A number of transforms were introduced earlier to illustrate the basic theorems 
of the Fourier transformation. Of course, one need not necessarily be aware of 
any particular Fourier transform pairs to appreciate the meaning of the theorems. 
Many of the chains of argument in which the Fourier transformation is important 
are independent of any knowledge of particular examples. Even so, carrying out 
a general argument with a special case in mind often serves as insurance against 
surprises. 

The examples of Fourier transform pairs chosen for illustration were all in¬ 
troduced without derivation and asserted to be verifiable by evaluation of the 
Fourier integral. Obviously this does not help when it is necessary to generate 
new pairs. We therefore consider various ways of carrying out the Fourier trans¬ 
formation. Numerical methods based on the discrete Fourier transform and al¬ 
lowing for use of the fast Fourier transform algorithm are discussed in Chapter 
11, but this chapter also advocates the slow Fourier transform algorithm that sim¬ 
ply evaluates the integral as a sum. The program is short, completely under the 
user's control, and runs in a few seconds for the majority of everyday applica¬ 
tions. 

Starting from the given function f(x) whose Fourier transform is to be de¬ 
duced, one may first contemplate the integral 

f°° f(x)e~ i2nxs dx. 

J -00 

If this integral can be evaluated for all s, the problem is solved. 

A number of different approaches from the standpoint of integration are dis¬ 
cussed separately in subsequent sections. 

In addition to this direct approach we have a powerful resource in the basic 
theorems which have now been established. Many of the theorems take the form 
"If/and F are a transform pair then g and G are also." Thus, if one knows a trans- 
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form pair to begin with, others may be generated. It is indeed possible to build 
up an extensive dictionary of transforms by means of the theorems, starting from 
the beginnings already laid down. It may be surmised that some classes of func¬ 
tion will never be stumbled on in this way; on the other hand, a variety of phys¬ 
ically feasible functions prove to be accessible. Generations from theorems is taken 
up later with examples. Finally, there is the possibility of extracting a desired trans¬ 
form from tables. 


INTEGRATION IN CLOSED FORM 


It is a propitious circumstance if f(x) is zero over some range of x and if in ad¬ 
dition its behavior is simple where it is nonzero. Thus if 

m = n(x), 


then 


* = f. 


r ,2 ™ d x 


= [ 3 1 cos 2ttxs Ax 


sin its 

7TS 

= sine s. 


If f{x) is nonzero on several segments of the abscissa and constant within each 
segment, the integration in closed form can likewise he done Thus if we let 

/W = »n( £ ^), 

ffe 4 k 

F(s) = I ae a ' nx - dx 
J i>-}r 

= a [ 

J-ic 

’1-1, cos 


then 


An 


= ac ,2 ' nbi | cos 27 tus An 


= ace~ ,2nbi si 


sine cs. 


It follows that if 


H \ L tl / 

F(s) = X a " c «e i2rrb ”* sine c„s. 


then 
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Functions built up segmentally of rectangle functions include staircase functions 
and functions suitable for discussing Morse code, teleprinter signals, and on/off 
servomechanisms. They not only occur frequently in engineering but can also sim¬ 
ulate, as closely as may be desired, any kind of variation. 

An even simpler case arises if f(x) is zero almost everywhere; for example, 
suppose that f(x) is a set of impulses of various strengths at various values of x: 


/(*) = S(x - b„). 

n 

Then only the values of a„ exp (-Httxs) at the points x = b„ can matter. By the 
sifting theorem for the impulse symbol, 

F(s)= [' '2a n 8(x-b')e-» m dx 

J -00 

= [ a, S(x — b,)r airxs dx + ( a 2 S(x - b 2 )e ,2 ” xs dx + ... 

)i> |- Jb 2 - 

= a x e~ a ^ + n 2 e~' 27,b * + .... 


If f(x) has some special functional form, it may prove possible to perform the 
integration, but no general rules can be given. Some simple examples follow. 

1. Let f(x) = sine x. Then 

F(s) = [ sincere a,rx * dx 

~ X> 

* sin 7 tx cos 2-nxs , 

- dx 

•to 7TX 

= }\ j 1 - * ZS sine [(1 + 2s)x] + 1 sine [(1 - 2s)x]j dx 

1 + 2s 1 - 2s 

“ 2 j 1 + 2s | + 211 - 2s | 

= n(s). 

We have used the result that 


sin (7 tx + 27 txs) sin (7 tx — 2ttXs) 


27TX 


27 TX 


dx 



f* . , 1 

sine ax dx = — 

J to \a 

2. Let f{x) = e~^. Then 

F(s) = 

= 2 e x cos 2ttxs dx 
Jo 
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= 2 Re 

f * dx 


Jo 

= 2 Re 

jars-Vxdx 


Jo 


-1 

= 2 Re 



Htts — 1 


4tt 2 s 2 4 - 1 


3. Let f(x) = e~ v *. Then 


e -«*y-a*ns dx 


F(s) = j " . 

= f K e~^ +i2xs) dx 
= e~ rsJ r e~^ x+uf dx 

J -OO 


= e""* 1 f 00 t ;-*<**& d{x + is) 

J -OC 


= 


In this example, we have used the known result that the infinite integral of 
exp (— nx 2 ) is unity. The next case illustrates a contour integral. 

4. Let f(x) = x~\ The infinite discontinuity at the origin causes the standard 
Fourier integral to diverge; hence we consider instead 

, - i2ttsx 


Now consider 


lim( I ' e —^~ 

« *0 \ J a. x 

r t ,-i2jrsz 

Jc Z 


dx + 


D 


where the contour C is a semicircle of radius R in the complex plane of z, whose 
diameter lies along the real axis and has a small indentation of radius e at the 
origin. The contour integral is zero since no poles are enclosed. Thus 


f:; 


, - iZws.r 


dx + 


f 


1 C 




dfi + 


r- 


i2n<x 


dx 


’ n 

ic~‘ 27T - 
o 


s/V" An - 


dG = 0. 


As R —>oo, the fourth integral vanishes and the second equals ± in according 
to the sign of s, so that we have 

+ l.') + '" sgns = a 

Hence the desired transform pair in the limit is 


1 
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5. Let f{x) = sgn x. This is the previous example in reverse, and it is seen that in 
this case the Fourier integral fails to exist in the standard sense because the 
function does not possess an absolutely convergent integral. Therefore consider 
a sequence of transformable functions which approach sgn x as a limit, for ex¬ 
ample, the sequence exp (— r|jcj) sgn x as r —> 0. The transform will be 



e ‘ t|t1 sgn x e 


i2nxs dx 


r o 

-^-•2** dX + 

1 1 


t ,-(f f /2irsK 

JO 


dx 


t — Hits t + Htts 


As r —» 0 this expression has a limit 1 /ins. Hence we have the Fourier trans¬ 
form pair in the limit. 


sgn * D 7 


1 


1775 


NUMERICAL FOURIER TRANSFORMATION 

If the values of a function have been obtained by physical measurement and it is 
necessary to find its Fourier transform, various possibilities exist. 

First of all, certain limitations of physical data will influence the result, and 
we shall begin with this aspect of numerical transformation. 

The data will be given at discrete values of the independent variable x. The 
interval Ax may be so fine that there is no concern about interpolating interme¬ 
diate values, but in any case we can take the view that the data can hardly con¬ 
tain significant information about Fourier components with periods less than 
2 Ax. Therefore it is not necessary to take the computations to frequencies higher 
than about (2 Ax) -1 . 

In addition, observational data are given for a finite range of x, let us say 
for -X < x < X. By a corresponding argument, the Fourier transform need not 
be calculated for values of s more closely spaced than As = (2X) If there were 
any significant fine detail in F(s) that required a finer tabulation interval than 
(2X)“‘ for its description, then measurements of/(x) would have to be extended 
beyond x — X to reveal it. 

These simple but important facts for the data analyst may be summarized by 
saying that the function f(x) tabulated at interval Ax over a range 2X possesses 
2X/Ax degrees of freedom, and this should be comparable with the number of 
data computed for the transform. In Chapters 10 and 14 the underlying thought 
is explored in detail. 

A further property of physical data is to contain errors. There is therefore a 
limit to the precision that is warranted in calculating values of the Fourier trans¬ 
form. This limit is expressed concisely by the power spectrum of the error com¬ 
ponent (or, what is equivalent, the autocorrelation function of the error compo- 
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nent). Sometimes only the magnitude of the errors is available, and not their spec¬ 
trum; and sometimes the magnitude is not known either. Nevertheless, the errors 
set a limit to the number of physically significant decimal places in a computed 
value of the transform. 

Let f(x) be represented by values at x = n, where the integer n ranges from 
— X to X. before the Fourier transform of f(x) can be computed, it is necessary to 
have information about f(x) over the whole infinite range of .v. Therefore we 
call on our physical knowledge and make some assumption about the behavior 
outside the range of measurement In this case suppose that f(x) is zero where 
|x| > X. Then the sum 

^ /(»K' 2r '" 

-X 

will be an approximation to F{ s). 1 he real and imaginary parts yield separate sums 

x x 

C - ^ f(n) cos 27W/ and S = ^ /(it) sin 2-rrsn, 

-x -x 

and the summations, over 2X + 1 terms, must be done for each chosen value of 
s, which can amount to a lot of computing. For this reason it is convenient to pos¬ 
sess tables of cosine and sine prepared for suitable values of s; but instead of be¬ 
ing limited to one quadrant they should run on and on, according to the size of 
X, showing negative values as they occur. Because of symmetry, summation from 
0 to X suffices for computing as discussed in Chapter 14. 

In the mid-sixties the signal processing community was profoundly influenced 
by Cooley and Tukey (1965). If one di\ ides the data set in two, takes the separate 
transforms, and combines them, the work can be approximately halved. Further 
subdivision into even shorter lengths is even better. C. Lanczos had already pub¬ 
lished on this in 1442, and indeed the idea was being used for numerical Fourier 
analysis of cometary data by C. F. Gauss in 1805, when he wrote, "Experience will 
teach the user that this method will greatly lessen the tedium of mechanical cal¬ 
culation." Consequently, after some years the term "Cooley-Tukey Algorithm" 
was dropped in favor of Fast Fourier Transform. The usual versions of the FFT 
pretabulate cosines and sines. O. Buneman showed that pretabulation of sin 6 
and tan l 2 V was faster (see R. V Bracewell, 1986), but as processor speeds increase 
year by year the intrinsic speed of algorithms assumes less importance. 

Libraries of subprograms for Fourier analysis and related signal processing 
and graphical presentation are available in books. See for example W. H. Press 
et al. (1986) and later volumes for subprograms, on various media, in BASIC, C, 
FORI RAN, and PASCAL. 

High-level software offerings including UNPACK, which is available free 
from Argonne National Laboratories, MATHFMAIICA, FORTRAN 90, and es¬ 
pecially MATI AB , which is student-friendly and which is discussed in Chapter 
11, with exercises, in connection with spectral analysis of data sequences, have 
greatly increased the convenience of access to numerical Fourier analysis. 
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The single MATLAB statement F = fft(f); will operate on a given se¬ 
quence {/} to generate the complex Fourier transform {F} virtually instanta¬ 
neously, whether the number of elements has factors, is prime, or is a power of 
2. The inverse transform is performed by if ft. 

In FORTRAN innumerable subprograms for variations on the fast Fourier 
algorithm have been published or are av ailable in packages, or "libraries," of 
general-purpose mathematical subprograms such as IMSL (1980) and NAG (1980) 
and are invoked by statements of the form CALL Fourier (f ,N, sign) that re¬ 
place the iV data values of {/} by the complex transform values. The forward 
and inverse transforms respond to the same call according as sign is 1 or — 1. 
FORTRAN 90 provides essentially the same facilities as MATLAB. 

All the purposes of numerical Fourier transformation may also be achieved 
by use of the I hartley transform (Chapter 12), which performs both Fourier analy¬ 
sis and synthesis without the need for a separate inverse procedure and does not 
generate complex output from real input. 

Meanwhile, the speed of computers has increased so much that the "slow 
transform," which directly evaluates sums C and S, may now run fast enough for 
some purposes. One use is to enable students of spectral analysis to do numeri¬ 
cal work before confronting the awkward subtleties of the fast algorithms. An¬ 
other use in class is to confirm entries in the Pictorial Dictionary and to gain ex¬ 
perience with some of the theorems by applying them to those entries. Work 
depending on algebra or calculus may introduce sign errors, factors of 2 or tt, or 
other slips of hand work, that can be fixed by checking a numerical case faster 
than by careful repetition of a derivation. Finally, the indispensable blackbox, or 
canned, routine cannot safely be approached without some understanding of its 
inscrutable content; comparison against a transparent program is instructive. A 
common experience is to be visited bv a student who has tried to run a canned 
fast Fourier transform package prematurely and is perplexed when a test run of 
rectangle-function data dot's not produce the expected sine function shape or am¬ 
plitude. 

The code segment following is short, and tolerant of rewriting by the user in 
language and symbols of preference. 


THE SLOW FOURIER TRANSFORM PROGRAM 

Let/(x) be given at integer values of x from -X to X, with values of zero being 
assigned where f(x) is undefined. If integer spacing is unsuitable, rescale the in¬ 
dependent variable as wanted. Read the data into an array f ( ) . For computer 

languages that do not allow the lower array index to be negative, set up a user- 
defined function to contain the data values. 

Since the real and imaginary parts of the transform do not come at integer 
values of frequency s, an integer array index k, proportional to s and running from 
0 to K, is introduced. The frequency s is k/2K. Real and imaginary parts R(k) and 
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l{k) are then computed by summing terms /(x)™ s 2irs.r. Finally, the complex trans¬ 
form is given by R(k) + il(k) for k > 0, while for negative k the transform is the 
complex conjugate R(k) - il(k). The values chosen for K and X must be stated in 
advance, the data array f ( ) needs to be filled, and any declarations of variable 
type, array dimension statements, and other obligatory protocol of the user's lan¬ 
guage also must be supplied. Here is the program for generating R(k) and I(k). 


FOR k = 0 TO K 
8 = k/<2*K) 


Frequency array index has K + 1 values 
Frequency variable, maximum is 0.5 


P=2*PI*s 

R(k) = 0 Real part of F(s) 

I(k) = 0 Imaginary part of F(s) 

FOR x = -X TO X Step in x is unity, limits are ±X 
R(k) = R(k) + f(x)*COS(P*x) 

I(k) = I(k) + f(x)*SIN(P*x) 

NEXT x 
NEXT k 


With many waveforms the choice of origin is unimportant because the wave 
shape does not depend on what instant is chosen as the origin of time. Thus the 
real and imaginary parts, which are heavily affected by user choice of origin, are 
not explicitly needed all that often. Instead, R and I are merely steps to getting 
the power spectrum R 2 + l 2 , which is an intrinsic property of the waveform it¬ 
self. The phase spectrum arctan (I/R) as a function of frequency is also more of¬ 
ten needed than R and /; choice of origin does affect phase but only by a simple 
linear phase shift with frequency. 

With data at unity spacing, the shortest period representable is 2; consequently 
the highest frequency about which information can be obtained from the data is 
s max = 0.5. The longest period that counts is 2X, the full span of the data; the cor¬ 
responding lowest frequency is s„„„ = \X, which also equals As. 

A choice of K = X will yield X + 1 values of R, and X values of I (not count¬ 
ing zero-valued i(0)), adding up to exactly the number of independent constants 
justified by the 2X + 1 original data values. The spacing As = \k over the range 
0 s =£ 0.5 will then produce the number of R and X values that is necessary and 
sufficient to recover the original data. Call As ir „ the critical spacing With a choice 
of K = 4X the spacing As is reduced to one-quarter of the critical spacing, and 
the additional interleaved values computed for / (s), while containing no extra in¬ 
formation, will make quite a difference to the appearance of a graph because of 
the closer packing of points. Conversely, letting k run from 0 to X/2 will stretch 
As to double the critical spacing, which is good when debugging a program or 
when little detail in T(s) is expected. 

By letting k run from 5X to 7X with K = 12X one selects a band around 
s = 0.25 with As = 1/24X; thus a narrow frequency band containing a feature of 
special interest mav be examined at 12 times the critical resolution. T his flexibil¬ 
ity of the user-created program is not offered by the standard fast algorithms. 

Finally, to check transform pairs for gross errors, see that R(0) equals the sum 
of the data values and that 1(0) = 0. By not computing R and / for negative 
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frequency one saves roughly half the running time compared with the standard 
fast Fourier transform. This time saving also characterizes the Hartley transform. 

Example. As input data try 

{i 1 1 1 1 1 1 1 1 1 1 1 £}, 

representing values of f{x) = II(.v/12), with a known transform 12 sine 12s. The 
number of data values is 13, with X = 6. Choose K = 2X = 12, which will yield 
transform values at half the critical spacing. The program will give 

R(k) = {12 7.596 0 -2.414 0 1.303 0 -.767 0 .414 0 -.132 0} 

and, since/(r) is even, all values of I(k) will be zero. As required, R(0) equals the 
sum of the data values; check the remaining values against the known transform, 
noting that R( 1) is 0.56% larger than 12 sine 0.5. 

Example. Choose K = 24, keeping the data unchanged at X = 6. This will 

give 

R(k) = {12 10.788 7.596 3.555 0..0 -.141 -.132 -.046 0}. 

The bold values occur at the previous values of frequency s, the interleaved fre¬ 
quencies give a smoother graph. The frequency spacing As is now one-quarter of 
the critical spacing. 

Example. Change X to 12 and pad the original data to 25 values by inserting 
preceding and following zeroes. Keep K at 24. Note that the transform values are 
not changed by zero padding. 

Example. Keep X at 12 but extend the data to 25 values starting and finish¬ 
ing with \ and having 23 ones in between. Keep K at 24. The result is 

R(k) = 2 X {12 7.629 0 -2.514 0 1.473 0 -1.014 0 .749 

0 -.570 0 .439 0 -.334 0}. 

Note that representation of FI(r) by twice as many values reduces the difference 
between R(l) and 24 sine 0.5 to 0.14%, a factor of 4 improvement Verify that the 
absolute error does not diminish as k increases. 

Example. Return to the first example with K = 12 and X -- 6 but change the 

first line of code to FOR k = 0 TO 2 * K thereby computing values of R(k) be¬ 

yond the meaningful limit s — 0.5. When k reaches 2 K, s reaches 1.0 and R 
climbs to the same value that it had at s = 0. This exercise shows how the 
discrepancy between R and 12 sine 12s arises mainly from the overlapping of a 
replica 12 sinc[12(s — 1)] and that in general the actual value of R is 

12 sinc[12(s — »;)]. Understanding this explains the improvement illus¬ 
trated in the previous example and shows how to gain improved accuracy by in¬ 
creasing the density of data values. 
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GENERATION OF TRANSFORMS BY THEOREMS 

A wide variety of functions, especially those occurring in theoretical work, can be 
transformed if some property can be found that permits a simplifying application 
of a theorem. For example, consider a polygonal function, as in Fig. 7.1. If wc per¬ 
ceive that it can be expressed as the convolution of the triangle function and set 
of impulses, then we can handle the impulses as described above and multiply 
their transform by the transform of the triangle function. Thus 

A(jc) * 2 A n 8{x - a„) D sine 2 s 2 

m n 

As an example take the trapezoidal pulse A(.v) * ii(r). Evidently 

\(.v) * ii(.y) D sinc 2 s cos tts. 

In practice the convolution theorem is frequently applicable for the genera¬ 
tion of derived transforms, and many examples of the use of the convolution the¬ 
orem and other theorems will be given in the problems for this chapter. 


APPLICATION OF THE DERIVATIVE THEOREM TO SEGMENTED 
FUNCTIONS 

There is a special application of the derivative theorem that has wide use in con¬ 
nection with switching waveforms. Consider a segmentally linear function such 



T 




Fig. 7.1 A polygonal function (above) that can be regarded as the convolution of 
a set of impulses and a triangle function (below). 
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as that of Fig. 7. 2n. The first derivative, shown in 7.2 b, contains an impulse. Since 
the transform of the impulse is known, we remove the impulse and differentiate 
again (7.2r). This time there remains only a set of impulses XC„ fif.v — c„). If the 
first derivative contained, instead of a single impulse as in the example, a set of 
impulses 'IB,, 8(.\ — b„), and if the original function f(x) contained impulses 
1A„ <5(.t - a„), then evidently the transform F($) is given by 

(/2tts) 2 T(s) = (/27rs) : ^ A,jl'~ ,2Tr “" s + i2TT<±B„e + i.C„e aw * 

Clearly this technique extends immediately to functions composed of seg¬ 
ments of polynomials, in which case further continued differentiation is required. 
As a simple example let us consider the parabolic pulse (1 - x 2 )n(.v/2). Here 

(1 - On(|) 3 m 

Differentiating twice, we have 

-2*nm D i2vsb'(s) 

28(x + 1) - 2lim + 28{x - 1) D (/27rs) 2 F(s). 




1_ 

_ i 

(b) 

t 





X 



Fig. 7.2 Technique of reduction to impulses by continued differentiation. 
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Now the left-hand side has a known transform 4 cos 2ns — 4 sine 2s. Hence the 
desired transform F(s) is given by 


F(s) = 


4 cos 2vrs — 4 sine 2s 
(/2tts) 2 


+ X,S( s) + K 2 S'(s), 


where X, and K 2 are integration constants arising from the fact that a constant X, 
may be added to the original parabolic pulse without changing its first derivative, 
and similarly for the second derivative. Integration of the given pulse shows that 
no additive constant or linear ramp is present, so in this case X, = X 2 = 0 and 


F(s) 


cos 2tts 

2.2 

7 T S 


sin 2ns 
2vr's 2 


MEASUREMENT OF SPECTRA 

While spectra can be determined mathematically either from waveforms ex¬ 
pressed algebraically or from discrete numerical data, the historical sequence of 
events begins with Isaac Newton as explained in his Opt irks of 1704. Spectra are 
still produced by prisms and other optical devices, especially diffraction gratings 
and Fabry-Perot interferometers. 

The following sections deal with two special cases of the determination of 
spectra from signals presented in physical form. 

Radiofrequency spectral analysis. Radio communication, radar, television, 
and laboratory instruments all make use of spectrum analyzers to display signal 
strength as a function of frequency. A radio receiver is being used as a primitive 
spectrum analyzer when the tuning knob is being turned; a commercial device 
can be imagined that mechanically varies the capacitance of a tuned circuit and 
displays the response on a cathode ray tube whose spot is moved horizontally in 
synchronism with the variation of the tuning capacitor. Such an instrument, even 
when voltage-controlled capacitors have eliminated moving parts, has only a lim¬ 
ited bandwidth. With the passage of time impressive advances have been made 
in digitizing oscilloscopes, so that the frequency band from d.c. to millimeter 
wavelengths can be covered with virtually level sensitivity. Such an instrument 
samples the waveform under study with conventional electric circuitry, performs 
fast spectral analysis by computer, and displays or stores the spectrum or any 
other desired product of digital signal processing. By 1990 fully programmable 
instrumentation based on the Hartley transform was commercially available with 
picosecond resolution. 

An alternative procedure is to employ a bank of fixed-frequency filters, im¬ 
plemented by computer to be sure, as exemplified by the SETI Institute in search¬ 
ing for radio signals from nonsolar planets over a 20 MHz band with resolution 
as fine as 1 Hz. 
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Optical Fourier transform spectroscopy. In the optical wavelength range 
spectrum analysis has been carried out by massively parallel analogue devices, 
namely prisms and diffraction gratings. But there is another way, not in the line 
of evolution from electric circuit practice, and it has become of particular impor¬ 
tance for detecting and identifying molecules by their infrared spectra. If one could 
determine the temporal autocorrelation of an electromagnetic signal s (t) then by 
Fourier transformation one would have the power spectrum. The technique for 
doing this is to split the signal to be analyzed into two beams with a view to form¬ 
ing the product s(t)s(t + r), where t is a variable time delay. Beam splitting can 
be accomplished with high efficiency by a mylar film oriented at 45°. One beam 
continues straight through with half the incident power; the other beam reflects 
at a right angle. Before the two beams are allowed to recombine and pass to a de¬ 
tector, a relative delay r is inserted in one beam. The beam to be delayed is di¬ 
verted towards a plane mirror and after reflection, returns to its original path. If 
now the mirror is moved away then an increasing time delay r is introduced. With 
a maximum delay t„,„ x a spectral resolution bandwidth of l T max ’ s achieved. The 
total band covered extends to a high frequency 2 At, where At is the time for 
which the moving mirror dwells at each value r. If the analysis has to be done 
fast, as when dynamic chemical reactions are to be studied, the mirror can be 
moved continuously, e\en at explosive speeds and a loud bang. In this case At 
is the change in r in one integration time of the final detected output signal. At 
the highest mechanical velocities and repetition rates required for transient analy¬ 
sis, linear motion cannot be counted upon. Instead, the mirror position is followed 
by counting optical interference fringes, or alternatively moire fringes, a count 
that is used to synchronize digitization at the detector output with the position 
of the moving mirror. 

It would suffice to work with positive delays only, since the autocorrelation 
function is even, and the time-averaged s(f)s(f + r) equals that of s(f — t) s(f). 
1 lowever, if t is varied from positive to negative then the origin of the autocor- 
relogram is apparent in the presence of small maladjustments. This is a practical 
point, but also supports a different function of the instrument. 

If instead of determining the spectrum of the incident radiation one uses a 
known spectrum, for example from a black-bodv radiator, then a transparent sam¬ 
ple may be placed in one beam and a cross-correlogram will be recorded. This is 
not an even function; Fourier transformation will now deliver a complex result 
from which properties of the sample, such as permittivity and conductivity, or re¬ 
fractive index and absorption coefficient, can be found over the full spectral range. 
This is a richer result than a simple absorption spectrum. Given an opaque spec¬ 
imen, one can use it as the moving mirror, determine the complex reflection co¬ 
efficient, and thence electromagnetic properties including conductivity, permit¬ 
tivity, and penetration depth (Bell, 1972). 

Although instruments for spectral analysis have originated and been devel¬ 
oped for use in applications outside the range of electrical engineering, manu¬ 
facture has been in the hands of the engineers who have brought us instruments 
for medical diagnosis, medical treatment, clocks, and navigational devices, illus¬ 
trating what Lord Kelvin said about Fourier's Theorem. 
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PROBLEMS 

1 . Checking the second moment. See whether the exact relation f'^x 7 f(x)dx = 
-F"( 0 )/ 47 t 2 can be made the basis for a numerical check of R(k), the computed real part 
of the transform of f(x) (as sampled at unit intervals of x over the range —X to X. The 
easily computed second moment x xZ f( x ) should agree with what property of 
R(k)? D> 

2. Transform of cos nx 2 . Evaluate f \ cos 7 r.v 2 cos 2nsx dx to show that the Fourier 
transform of cos 7 tx 2 is F(s) = 2' 2 (cos 7 ts 2 + sin ns 2 ). Before attempting the integra¬ 
tion think how you could apply a numerical check in case a gross error has been made 
by omission of a factor such as V 2 or \'tt. t> 

3. Transform of exp inx 2 . Show that 

c’” 1 ’ D Vk , ~ w . I> 

4. A more symmetrical transform. Show that 

- i) 3 t . J) 

5. Unsymmetrical function. A function of x that is nonzero only for —16 < x < 16, and 
is neither even nor odd, is \(.v/16) + A(*/8 + 1). (a) Confirm that its exact Fourier 
transform is f(s) = 16 sine 2 lbs + 8 sine 2 8s exp(i’27r8s). (fc) Tabulate the 33 values of f(x) 
for.v = -16,-15, ... 16 and use them in the slow F. I program to compute the real and 
imaginary parts of the transform for 0 s s s; 0.5 with As — 1/64, which is half the crit¬ 
ical spacing that the FFT would generate, (c) Comment on the agreement of the results 
with the exact real and imaginary parts of T(s). C> 

6 . Unsymmetrical function. Values of a certain f(i) for i = -4 to 4 are 

{1 2345678 9}. Use the slow Fourier Transform for values of s running 

from 0 to 0.5 at intervals As = 1 18 and compare the results with the transform of 
*(*) = .v n[(x-5)/9].t> 



150 


The Fourier Transform and Its Applications 


7. Central limit theorem? Does the product (1 - s 2 )(l - s 2 /4)(l - s 2 /9)...(1 - s 2 /N 2 ) 
approach Gaussian form for s « 1 as N becomes large? t> 

8 . Weekly summing. The occurrence of certain events is dependent on, or correlates with, 

the day of the week, examples ranging over happenings as diverse as emergency-room 
admissions, atmospheric clarity, and noise pollution. Summing the number of events as 
a function of the day of the week provides a statistical tool for investigation and possi¬ 
ble mitigation. Given a data set g, for / = 0 to 6, accumulated in this way over a whole 
number of weeks, an investigator considers Fourier analysis. Since there are exactly 
seven data values, no more than seven independent numbers F k (k = 0 to 6) should 
be generated bv such a change in mode of presentation. In the case of a data set 
g = (5 4 9 8 7 6 10} from Sunday to Saturday, what are the seven numbers 

F»? > 


9. Sine transform. Find the sine transform F.(s) for /(.v) = \(x/a - 1). 

10 . Cosine transform. Find the cosine transform b\(s) for f(x) = A (x/a - 1). 




The Two Domains 


We may think of functions and their transforms as occupying two domains, 
sometimes referred to as the upper and the lower, as if functions circulated at 
ground level and their transforms in the underworld (Doetsch, 1943). There is a 
certain convenience in picturing a function as accompanied by a counterpart in 
another domain, a kind of shadow which is associated uniquely with the func¬ 
tion through the Fourier transformation, and which changes as the function 
changes. In the illustrations given here the uniform practice is to keep the func¬ 
tions on the left and the transforms on the right. 

The theorems given earlier can be regarded as a list of pairs of correspond¬ 
ing simultaneous operations, one in the function domain and the other in the 
transform domain. For example, compression of the abscissas in the function do¬ 
main means expansion of the abscissas plus contraction of the ordinates in the 
transform domain; translation in the function domain involves a certain kind of 
twisting in the transform domain; and convolution in the function domain in¬ 
volves multiplication in the transform domain. 

By applying these theorems to everyday problems we are able at will to cross 
from one domain to the other and to carry out required operations in whichever 
domain is more advantageous. We may find on reaching the conclusion to a line 
of argument that we are in the wrong domain; our conclusion is a statement about 
the transform of the function we are interested in. 

We therefore now consider pairs of corresponding properties; the area under 
a function and the central ordinate of its transform are such a pair. Suppose that 
we are interested in the area under a function, but we have only its transform; 
the desired quantity proves to be equal to the central ordinate of the transform. 
It is not necessary for us to invert the- Fourier transformation in full and to inte¬ 
grate the function so determined. 

It very often happens that particular features of a function are all we need to 
know. The corresponding pairs of properties assembled here then assume an im- 


151 




152 The Fourier Transform and Its Applications 

portant role in enabling us to sidestep details of transformations and go to a di¬ 
rect answer. 


DEFINITE INTEGRAL 

The definite integral of a function from -oo to oo is equal to the value of its trans¬ 
form at the origin; that is, 

[ " f(x)dx=F( 0). 

J OO 

Derivation: 

[* f(x) dx = [ X f(x)e ,2 ™ dx = F( 0). 

J-* s -o 

We often refer to this integral as the area under a function; thus in Fig. 8.1 it 
is the area shown shaded. The term "central ordinate" is used for the value at the 
origin of abscissas and this value is indicated in the figure by a heavy line. 

It follows from the symmetry of the Fourier transform that the area under the 
transform is equal to /(0). From this simple correspondence of properties many 
very interesting conclusions can be drawn. For instance, any operation on f(x) 
which leaves its area unchanged—say a translation along the x axis—leaves the 
central ordinate of the transform unchanged. In the case of translation, this con¬ 
clusion is verifiable from the shift theorem, for 

/(* rt)| 0 = e- a ~F(s) | 0 = F(0). 

A more abstruse example is furnished by f(x — a)H(x - a) + f(x + a)H(—x - a), 
where a given f(x) is separated at .v = 0 into two equal parts, which are then 
pushed apart by an amount 2 a. Since the area has not been changed, the central 
ordinate of the transform is the same. On the other hand, since the central ordi¬ 
nate of the function is now zero, we can say that the area of the transform must 
now be zero. These two special facts about the transform are a good example of 
the powerful reasoning based on corresponding properties. 


= central ordinate 




Fig. 8.1 The area under a function is equal to the central ordinate of its transform. 
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■ TABLE 8.1 
Some functions and 
their areas 


/(V) 

no) 

fix) 

r< 0) 

nu) 

l 

cos \ 

0 

sine x 

l 

'l(-v) 

0 

A<*> 

l 

sin x 

0 

sine 2 x 

i 

M(.v) 

■DC* 

e wr 

i 

f>(x) 

l 

/,>(*) 

l 

p“ 

0 

/.w 

— - 

l 

H * 

00 

X 

>•(*) 

l 

sgn x 

0 


Exercise. If f{x) were a rectangle function, then the foregoing operation of 
splitting and separating the parts would result in a rectangular pulse pair. Obtain 
the full transform by use of the modulation theorem, and verify that the infinite 
integral of the spectrum of a pulse pair is indeed zero. 

Exercise. What distinctive character can you assign to the spectrum of a sig¬ 
nal in Morse code? 

In Table 8.1 many special cases are collected, the right-hand column showing 
the area under the function to the left. 

Exercise. The functions cos x and sin .v have infinite integrals which are os¬ 
cillatory, yet tine central ordinates of their transforms have a perfectly definite 
value of zero. However, the transforms arc transforms in the limit. Tine definite- 
integral/centra 1-ordinate relation, when applied to transforms in the limit, must 
thus imply some rule for integrating (co)sinusoids. Investigate this matter. Hint: 
Consider transformable functions such as cos x ri(.v/M) and cos .v Til(x - 
with the aid of the convolution and shift theorems, in the limit as M —>oo. 

Exercise. Consider w-hat would be appropriate entries in the table for H(x) 
and sgn x. 


THE FIRST MOMENT 


By analogy with mass distribution along a line, the first moment of/(x) about the 
origin is defined as 
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|_ x */(*) dx. 

The following theorem connects the first moment of a function with the central 
slope of its transform. 

If f(x) has the Fourier transform F(s) then the first moment of f(x) is equal to 
-(2iri )~' times the slope of F(s) at s = 0; that is, 



Derivation: By the derivative theorem, 

I ' (-27 Tix)f(xy-' 2 ^dx= F'(s). 

; - x 

Therefore ~2ni I ' xf{x)dx = F'( 0). 

J Xz 

In Fig. 8.2 the impulse pair, -i|(.t) is shown with its transform -i sin tts. Each 
impulse has a positive moment hence the total moment is thus 

- I .vi|(.v) dx = - ( 45(.v + [)dx + [ XjS(x - {)dx = 

J -oo J -30 J - 3 C 

Hence F'(0) = (—27ri)^ = —in. 

In Fig. 8.3 a truncated exponential and its transform are shown. The deriva¬ 
tive of the real part ot the transform is zero at the origin, so the "slope at the ori¬ 
gin" is given by the derivative —/ tan V of the imaginary part alone. The first mo¬ 
ment of the exponential distribution is thus given by (tan Q)/2tt, a positive real 
quantity. 



Positive moment = § Slope = -177- 


Fig. 8.2 The moment of a function is proportional to the central slope of the trans¬ 
form. 
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Fig. 8.3 The abscissa of ihe center of gravity is equal to (tan 0)/2irh. 


As a special case consider a function whose first moment is zero. Its trans¬ 
form has zero slope at its origin. Conversely, if a function has zero slope at the ori¬ 
gin, its transform has zero first moment. Furthermore, if a function has zero slope at 
the origin and is not zero there, then its transform has its center of gravity at the 
origin. 

Exercise. Discuss the first moment and center of gravity of the transform of 
nu- - a) as a goes from zero to infinity. 

Exercise. The function (a* — z)n(x — z) is zero and has zero slope at the ori¬ 
gin, and it has zero area. What can be said about its transform? 

Exercise. Under what condition on /(a) will the derivative of F(s) be purely 
imaginary at s = 0? 


CENTROID 

By the centroid of f(x) we mean the point with abscissa (a) such that the area of 
the function times (a) is equal to the first moment. Thus 



Roughly speaking, (a) tells us where a function f(x) is mainly concentrated or, 
when a signal pulse is described as a function of time. (/} bears on the epoch of 
the signal. In statics, (a) is the abscissa of the center of gravity of a rod whose mass 
density is /(a). L ate we shall find that the centroid of /(a)] 2 is a more suitable 
measure of location or epoch in cases where /(a) can go negative. In the worst 
case the area of f(x) is zero and (a) becomes infinite. 

Since (a) is the ratio of the first moment to the area of /(a), its connection with 
F(s) follows immediately from the preceding sections: 
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/ \ _ _ 1 

2niF(0) 

In other words, the abscissa of the centroid of a function is given by the central slope 
over the central ordinate of its transform, the constant of proportionality being 
-(2tt/) 

If the example of Fig. 8.2, chosen to illustrate first moments, the area under 
f(x) is zero, and so the idea of center of gravity fails. To give an analogy from me¬ 
chanics, if ii(.v) described a distribution of forces applied to a lever, then no bal¬ 
ance point could be found to which an equilibrating force could be applied. 

In Fig. 8.3, however, the center of gravity of /(a) falls at a finite positive value 
of a. Since f(s) is hermitian, its derivative at the origin is purely imaginary, say, 
i tan 8; the central ordinate h is given by the value of the real part of F(s) alone; 
thus 


(a) = 


tan 0 
2rrh 


MOMENT OF INERTIA (SECOND MOMENT) 

The moment of inertia or second moment of a function f(x) about the origin is 
defined as 

j“ ,e/(.v)rf.v. 




_ /] 

High moment of inertia 



Fig. 8.4 The moment of inertia is proportional to the central curvature of the 
transform. 
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Fig. 8.5 A function with an infinite second moment has a transform with a dis¬ 
continuity in slope at the origin. 


One finds that the higher the second moment of a function the more curved its 
transform at the origin (Fig. 8.4). Because of the factor v 2 , it is clear that the sec¬ 
ond moment of a function is sensitive to the behavior of f(x) at large values of v; 
thus what happens at large x is reflected in the behavior of the transform at the 
origin of s. This remark also applies to the theorem on the first moment. 


The moment of inertia off(x) is equal to (4ir 2 ) 1 time s the downward curvature of its 
transform at the origin; that is, 

J; a 2 /(*Kv = ~ 2 r"(0). 


Derivation: Bv the derivative theorem, 

| * {-i2irx) 2 f{x)e~ am ' dx = F"(s). 


Therefore 


D , F"(0) 

I .**/»*■ 


A special situation of frequent occurrence is shown in Fig. 8.5, where a func¬ 
tion whose second moment is infinite has a transform whose central curvature is 
infinite, that is, the slope jumps abruptly at the origin. 


MOMtNTS 


The nth moment of/(.v) is equal to (-27r/) " times the nth differential coefficient 
of F(s) at the origin; that is. 



f*">(0) 


provided that the moment exists. 
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If /(A) behaves as a " for large J.y 1 , where m is positive, then only the first 
[mi] moments will exist, and only the first [»/] differential coefficients of F(s) at 
s = 0 will exist; there will be a discontinuity of the m + 1 ]th order at s = U. (The 
function [in] is the greatest integer less than in.) 

For example, if in is a positive integer M, and f(x) dies away as x M , then the 
Mth moment is infinite and the Mth derivative of F(s) is impulsive. Conversely, if 
the Mth derivative of f(x) is impulsive, then its transform F(s) dies away as s M 


m 

MEAN-SQUARE ABSCISSA 

The mean-square abscissa, which will be represented by (.v 2 ) is the mean value of 
x 2 , the mean being weighted according to the distribution/(.v). Thus 

(* 2 ){ x f(*)dx = j ^ x 2 f(x) dx. 

and hence by previous results 

F''(0) 

4tt 2 F(1o) 

In dynamics, the square of the radius of gyration of a rod whose mass den¬ 
sity is f(x) is the same as (x 2 ). In statistics, (x 7 ) for a frequency distribution func¬ 
tion f(x) is an important concept the same as the variance of the function /(.v)] 
and it is useful to know the relationship it bears to the Fourier transform of f(x) 
(the "characteristic function"). The mean-square abscissa possesses a very inter¬ 
esting additive property under convolution 

The mean-square abscissa for f * £ is equal to the sum of the mean-square abscissas 
for f and g, provided that f (or g) has its centroid at its origin. 

We expect the convolution f * g to be wider, in some sense, than either of its 
components; this theorem is one quantitative expression of the smoothing-out or 
diffusing effect of convolution. 

Derivation: 



j_, x Af * X) dx = x\j * g) 


-(4T7 2 ) ’(/*£)" 


= -(4tt 2 )- , (FC)" 


= -(4tt 2 )- | [F"G + 2 F'C + FG"] 0 



o 
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Af * x) dx 

«/., = ■ g - 

I {f * g ) d.r 




F" F'C' G" 

— + 2 -+ — 

F FC G 


The final term on the right-hand side, which is twice the product of the abscissas 
of the centroids of /and g, will vanish if either/or £ has its centroid at its origin. 

By taking g(.v) = 5(.v — a), for which (x 2 ) g = a 1 , we have the theorem which is 
familiar in relation to the moment of inertia of a mass about an axis not through 
its center of gravity. For if /(a) has its origin at its centroid, 

{AHr-a) = (Af + « 2 - 

Other wavs of weighting the means of a may be considered. For example, if 
f{x) has negative-going parts, they will reduce the variance, but there may be in¬ 
terest in measuring the spread of fix) irrespective of its sign. Two quantities which 
are met in these circumstances are 

(Af and 


RADIUS OF GYRATION 

This term stands for the root-mean-square value of x —that is, the square root of 
the mean-square abscissa—and its convenience is largely associated with ha\ ing 
the same dimensions as x. Properties such as the relation to the central curvature 
of the transform, the additive property, and the radius of gyration about a dis¬ 
placed axis, arc usually simpler when expressed in terms of the mean-square ab¬ 
scissa rather than in terms of its square root. 


VARIANCE 


The variance <r 2 is the mean-square deviation referred to the centroid; that is. 


J (x - (x)) 2 fix) dx 
fix) dx 

F"j 0) | [F'(0)] 2 

4tt 2 F(0) 47r[F(0)] 2 ' 



and the statements about (x 2 ) apply also to variance, since a choice of the origin 
of abscissas which makes (x) zero will mean that (x 2 ) is the same as the variance. 
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The variance of f * g is equal to the sum of the variances of f and g. 
The proof follows from the earlier result for mean-square abscissas. 


SMOOTHNESS AND COMPACTNESS 

The smoother a function is, as measured by the number of continuous derivatives 
it possesses, the more compact is its transform; that is, the faster it dies away with 
increasing s. 

If a function and its first « — 1 derivatives arc continuous, its transform dies 
away at least as rapidly as |s| <M + I) for large s; that is, 

lim |s|"F(s) = 0. 

In the customary symbology of Landau, F(s) — 0(|s "). In the course of the proof 
of this theorem the Fourier transforms of the first n — 1 derivatives appear, and 
it is therefore necessary to mention, in a rigorous statement of the theorem, that 
the first n derivatives should possess absolutely convergent integrals. 

In Fig. 8.6 several of the common cases are illustrated. The rather familiar fact 
that sine 2 .v dies away much more rapidly than sine x is seen to be associated with 
the smoother behavior of its transform. We can say that functions possessing dis¬ 
continuities in slope ("corners"), and whose second derivatives are therefore im¬ 
pulsive, will have transforms that die away as s| 2 . In general one can say that 
if the kth derivative becomes impulsive, then the transform behaves as |s|~ l at in¬ 
finity. This simplifies statements, such as the one given above, which contain 
n — 1, n, and n + 1 in the same sentence. 

It is interesting to note that the function exp (—-n-x 2 ) is continuous and has all 
continuous derivatives, and is therefore in the present sense as smooth as possi¬ 
ble. Likewise its transform exp (-7rs 2 ) is as compact as possible, since it dies away 
faster than s~” for all n. This property is not unique to exp (-7rx 2 ), being shared 
with many other pairs of transforms (including, for example, the self-reciprocal 
pair sech ttx, sech 7rs). 

To prove the above statement, let/(x) have an absolutely integrable deriva¬ 
tive [/(x) is of course itself absolutely integrable and differentiable]. Since /'(x) is 
absolutely integrable, 

g(x) = [ /'(I) di 

J -oo 


exists, and since g'(x) = /'(.v), 

/(*) = g(x) + c. 

As x—> — oo, g{x)— >0. Now if c were not zero,/(x) could not be absolutely inte¬ 
grable. Hence g(x) — /(x), and thus asx-> — oo, we also have /(x) —r 0. 
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/(*) 

F(s) 

|s|° 

J 

J_ 

i 

_ 1 _ _ 1 _ 

_ 1 _ 


X s 

Function itself implusive 



_l_I_I_I_1_ 

First derivative implusive 






Fig. 8.6 If the Jcth derivative of a function becomes impulsive, its transform be¬ 
haves as !s| -k at infinity. 


Now put 

f°° /'(£) d£ = c,; 

J -oo 

then /(*)”[’ n()d( = c, - [>(«#. 

J -00 J X 

So again c, = 0 and thus /(*)—► 0 for x —► oo. Now 

F(s)= [' f(x)e~ ,2TTSX dx 

J -oo 



162 


The Fourier Transform and Its Applications 


f\x)e- a ” fX dx 

Hits 

on integrating by parts and using the fact that f(x) —>0 as v —» ± oo. 

Then 

sF(s)—>0 as s —> ±oo 

sf(s) = o(|s| ’) 

or F(s) = o(| S |- 2 ). 

If then, continuing the argument,/(.v) possesses n absolutely integrable deriva¬ 
tives, we have F(s) = o(|s| "). 


SMOOTHNESS UNDER CONVOLUTION 

We know from numerical experience that convolution produces broadening and 
smoothing effects. This is also expected on physical grounds in situations such as 
scanning the sound track of a film, where convolution describes the physical phe¬ 
nomenon. One way of giving a precise definition to the general idea of broaden¬ 
ing has already been established; thus it is known that the standard deviation cr f , 
which is a measure of spread of a function f(x), is increased under convolution 
with g{x) according to the result 

trj.g = a} + <r 2 . 

I here are other ways of measuring spread, and smoothness too could be mea¬ 
sured in different ways. If an automobile were driven along a road whose height 
varied as Id* 2 , or \(x), the ride would not be smooth; but it would be smoother 
than driving along a road described by II (.v), which has cliffs. A road surface Id* 3 , 
composed of two straight and three parabolic segments, free from abrupt changes 
in height or slope, would be smoother. It would not be perfectly smooth, for at 
each of the four points of articulation there would be an abrupt change in the cen¬ 
trifugal force, associated with the abrupt change in curvature. In these cases the 
smoothness increases with the number of derivatives possessed by the function. 

Let us say that if the kth derivative of a function is impulsive, then it has 
smoothness of order k. Now let/(.\) have smoothness of order w, and g(x) smooth¬ 
ness of order n. When they are convolved together, is the convolution indeed 
smoother, as we would wish, under our quantitative definition? 

Since 


F(s) - s 
C(s) - s“" 
T(s)G(s) — s 


and 

it follows that 


<m t it) 
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But F(s)G(s) is the Fourier transform of / * g, hence the (m + n)th derivative of 
f*g is impulsive, and it therefore has smoothness of order m + n. It is thus 
smoother than the functions entering into the convolution; in fact the smoothness 
proves to be additive under convolution just as a 2 is. 

The word "smoothing" is sometimes used as a synonym for convolution "In¬ 
verse smoothing" and "sharpening" are terms used to mean solving the convo¬ 
lution integral equation. It is rather interesting from the standpoint of this section 
that "sharpening" procedures make use of further smoothing. Consequently the 
quantitative measure here given to smoothness does not always coincide with 
qualitative conceptions of smoothness. As a particular example, consider 
A(.y) * t 1 exp (-7ta 2 /t 2 ), where r is very small. This function is now infinitely 
smooth but is a close approximation to the rough \(.v). It differs appreciably only 
at the corners, which are microscopically rounded off to prevent impulsive de¬ 
rivatives. The new road profile might, however, be just as rough to ride over as 
the old. 


ASYMPTOTIC BEHAVIOR 

It is well known qualitatively that sharp or abrupt features in a waveform beto¬ 
ken the presence of high-frequency components. Now we can go further and say 
quantitatively how the spectrum holds up as frequency increases. 

We have seen that if a function is continuous but has a discontinuous deriv¬ 
ative—that is, it has no jumps but has corners—then its transform dies away as 
s 2 and its power spectrum as s -4 . To describe such behavior in electric-circuit lan¬ 
guage, we would refer to it as attenuation at 12 decibels per octave or 40 decibels 
per decade. 

On a log-log plot, a function varying as s 2 would become a straight line of 
slope —2. Logarithmic units such as the octave or decade, the decibel, the neper, 
and the magnitude (in astronomy) permit slope, which is dimensionless in itself, 
to be stated in expressive dimensionless units. 

Figure 8.7 shows linear and log-log versions of two familiar functions. (Where 
the function is negative, the logarithm of the absolute value is shown.) Certain 
aspects of the functions, especially the nature of their asymptotic behavior and 
their closeness of approach thereto, are more clearly evidenced by the logarith¬ 
mic than bv the linear plot. For this and other reasons, logarithmic plots are of¬ 
ten used to display electrical-filter characteristics and antenna patterns. 

The question arises why only slopes of 0, 3, 6,..., decibels per octave were 
encountered when discontinuities of various kinds were discussed in the pre¬ 
ceding section. We can study this by considering some transform which dies away 
at 4.5 decibels per octave, that is, as s \ and inquiring what sort of discontinuity 
the correspond mg original function possesses. 

Since division by s corresponds to integration, division by s l corresponds to 
half-order integration. We ignore powers of 2iri. 
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sine x 




(a) 


Octaves 



Fig. 8.7 Asymptotic behavior as expressed on a double logarithmic plot in deci¬ 
bels per octave: (a) linear plot for comparison; (b) logarithmic plot (nega¬ 
tive lobes shown broken). 


The examples tabulated in Table 8.2 show that for the purposes of asymptotic 
behavior there are indeed discontinuities intermediate in severity between jumps 
and corners. Thus a corner where a function changes its slope from horizontal to 
vertical (A) ranks midway between simple corners and simple jumps. A discon¬ 
tinuity (6) midway between a simple jump and an impulsive infinity proves to 
be less severe. 

There arc further subtleties to this matter. Thus 6 (.y) and x 1 prove to have the 
same kind of infinity at x — 0, and the infinite discontinuity of log x, which is of 
the weakest possible kind, proves to be equivalent to a simple jump. 


EQUIVALENT WIDTH 

A convenient measure of the width of a function, for certain shapes of function, 

(' f(x)d:x 

J -oc _ 

m 


IS 
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■ TABLE 8.2 

Fractional-order discontinuities _ 

Asymptotic 
behavior of 

spectrum H(x) n(x) 

First | | 

derivative s° 


Half-order 
derivative s ’ 

B 

X 

*C 1 v 


Original s' 


V~ 

1 

“1 

1 Ulf-order 
integral s ’ 

A 



Integral s 2 




that is, the area of the function divided by its central ordinate. Expressed differ¬ 
ently, the equivalent width of a function is the width of the rectangle whose height 
is equal to the central ordinate and whose area is the same as that of the function. 
This is illustrated in Fig. 8.8. 

Examples can be drawn from many sources In spectroscopy the equivalent 
width of a spectral line is defined as the width of a rectangular profile which has 
the same central intensity and the same area as the line. In antenna theory the 
effective beamvvidth of an antenna has the character of an equivalent width 
(Chapter 15). Other examples occur in radiometry (Chapter 17). Some examples 
of functions, with accompanying rectangles illustrating their equivalent width, 
are shown in Fig. 8 9; all the examples have the same equivalent width. 

If /(0) = 0, the equivalent width does not exist For all cases, however, where 
/(0) =* 0 and f(x)dx exists, there exists an “equivalent width," even though 
the character of equivalence in the spectroscopic sense is lost. 
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One expects that the wider a function is, the narrower its spectrum will 
be, but as functions of various shapes are contemplated, can we express this 
inverse relationship quantitatively? It turns out that a very precise relation 
exists. Whenever the equivalent width exists, it possesses the following elegant 
property. 

The equivalent width of a function is equal to the reciprocal of the equivalent 
width of its transform; that is. 


j^/CvK* F(0) 



This theorem is reminiscent of the similarity theorem, according to which the 
compression and expansion of a function and its transform behave reciprocally. 
The similarity theorem, however, is restricted to functions of a given shape. The 
present theorem says what quantity it is that behaves reciprocally, and it permits 
unlike functions to be ranked in order of that quantity. 

Equivalent width is not always the best measure of width. For example, in 
expressing the bandwidth of a filter or the beamwidth of an antenna, it is com¬ 
mon to adopt the "width to half power." According to this measure the second 
example illustrated above is narrower, for some purposes, than the first, which 
agrees with experience. 

An interesting paradox arises when a localized turbulent motion spreads out¬ 
ward in space while the turbulence spectrum spreads out to higher wave num¬ 
bers. In this case equivalent width is the wrong measure of spread. 

The effective solid angle of an antenna radiation pattern (which is equal to 
47r/directivity) is the "equivalent width" of the pattern, generalized to two di¬ 
mensions. 


Exercise. Investigate the behavior of equivalent width under convolution, be¬ 
ginning with some exploratory trials on Gaussian and rectangle functions of var¬ 
ious relative widths. 

Table 8.3 lists equivalent widths for a number of common functions, together 
w ith autocorrelation widths, which are introduced in the next section. In this table 
the following abbreviations arc used: 

/ * / = J_/(^ + « )f{u)dn 


W, 


1 

/( 0 ) 



ilx 


W,. = 


/*/ lo 




iix 
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■ TABLE 8.3 



+The value given is /( 0+). 
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tThe value given is /(0 *). 
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AUTOCORRELATION WIDTH 

Another interesting "width" is the equivalent width of the autocorrelation func¬ 
tion, which we shall call the autocorrelation width: 

J* (/-./)<!* \fdx\fdx 

w, -> = “~T- ‘TiT - 

Autocorrelation width so defined does not necessarily refer to concentration about 
the origin For example, the two functions shown in Fig. 8.10 would have the same 
autocorrelation width because they have the same autocorrelation function, but 
they would not have the same equivalent width. If a rectangular pulse were con¬ 
sidered, then the idea of equivalent width could completely break down simply 
as a result of displacement along the axis of abscissas, because the central ordi¬ 
nate could fall to zero. This possibility is eliminated when one uses the equiva¬ 
lent width of the autocorrelation function, which is a maximum at the origin, 
never zero. 

It is clear from the reciprocal property of the equivalent widths of a function 
and its transform that the autocorrelation width of a function is the reciprocal of 
the equivalent width of it s poiuer <pectrum. Thus the idea of autocorrelation width 
breaks down if the equivalent width of the power spectrum loses meaning. This 
happens when the power spectrum has a zero central ordinate, which in turn 
means that the function (and its autocorrelation function) have zero area. 

Hence, in relation to functions such as those used to represent wave packets 
which have little or no direct-current component, the autocorrelation width is not 
an appropriate measure of "extent" or duration. 

The reciprocal of the autocorrelation width of the transform of a function is 
the equivalent width of the squared modulus of the function: 

j //* ix 

/( 0 )/*( 0 ) 



Fig. 8.10 Functions with different equivalent widths but the same autocorrelation 
width. 
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The advantage of autocorrelation width as a measure of dispersion comes 
from the removal of the sensitivity to the value of the central ordinate exhibited 
by the equivalent width. Two functions that have the same power spectrum, but 
whose spectral components are slid about into any relative phase, have the same 
autocorrelation function. Therefore the quantity copes with (1) displace¬ 

ment of the function away from the origin and (2) internal phase interference of 
the spectral components, which happens to produce a small central ordinate. How¬ 
ever, of two functions with the same power spectrum, one can be narrow and an¬ 
other wide. For example, the Fresnel diffraction radiation fields on planes parallel 
to an illuminated aperture have the same autocorrelation, but on any intuitive view 
the width of the illumination increases with distance from the source aperture. 

Difficulty (1) can be removed by considering equivalent widths about the cen¬ 
troid. Difficulty (2) indicates that (a) internal phase relations of the components 
cannot be ignored and that (b) a width measure hinging on some one ordinate 
will always be sensitive as a consequence. 

This critical approach to width measures should not obscure the fact that 
equivalent width and autocorrelation width both occur as the appropriate quan¬ 
tity in particular physical circumstances. Thus it would be pointless to criticize 
the sensitive dependence of antenna directivity on one ordinate of the radiation 
pattern. 

A situation where the autocorrelation width occurs is rectification of white 
noise passed through a filter. It is well known qualitatively that the average in¬ 
terval between effectively independent output values is inversely proportional to 
the "width" of the pass band. In fact it is the autocorrelation width of the power 
pass characteristic for which this statement is quantitatively accurate. 

An important property of the autocorrelation width which fits it for many 
applications is its invariance under shuffling (see Problems). 


MEAN-SQUARE WIDTHS 


Since the equivalent w idth and concentration just described do not fill all needs, 
other measures of width are also encountered. For example, the mean-square value 
of r defined by 


<.r) = 


x 2 f(x) llx 

—-~v _ 

/(-') dx 


is widely appropriate as a width measure, as is also the variance in functions not 
centered on the origin of v: 

<(.v - <r»*> - (.r 2 ) - <*> 2 

F"( 0) 1 |T(0)] 2 

” -4tt 2 F(0) ^ 4 7T 2 [ F(0) . ' 
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These measures break down when the area of the function is zero and are 
therefore inappropriate for measuring the width of an oscillatory signal or wave 
packet. To cope with this case we think in terms of the energy density and the 
centroid and variance of the energy distribution. We shall refer to the mean-square 
departure from the centroid of |/(a )| 2 as the variance ot the squared modulus, and 
it is given by 



This may seem an elaborate expression for the simple physical idea of duration 
or bandwidth of a signal packet, but it behaves more reasonably for man\ pur¬ 
poses than the simpler measures considered before. 

Of course, the square of a gi\en function may not have a finite variance; for 
example, sine a and (a 2 + 1) two concentrated peaked functions hav ing rea¬ 
sonable "equivalent widths" and "autocorrelation widths," show up as infinitely 
broad on a variance basis. Caution is therefore necessary before assuming that 
widths based on variance will have any relation to intuitive ideas of width in par¬ 
ticular cases. 

In the rigorous expression of the uncertainty relation referred to below, the 
squared uncertainties are variances of squared moduli. Suppose an observed 
quantity had the form sine a, as would happen if an impulsive wave were sam¬ 
pled with receiving equipment of limited high-frequency response, or if an infi¬ 
nite plane wave were sampled through an aperture of limited spatial extent. Then 
that spread which is subject to the quantitative uncertainty relation would evi¬ 
dently be by no means as well in agreement with one's intuitive notion of the 
spread as it is in the case of a Gaussian packet exp (~o\ 2 ) sin a. 

Table 8.4 lists the centroid and the mean-square abscissa for a variety of 
functions. 


SAMPLING AND REPLICATION COMMUTL 

When a function /(a) defined for values of a from —oo to oo is subjected to the 
operation of regular sampling at unit interval the result is the sample set 
{ . . . /(.v -t 2) /(.v t 1) /(a) /(.y — 1) f{x — 2) . . • }. The result of replica¬ 
tion of /(a) at interval X is the function . .. + /(a + 2X) + /(a + X) + /(a) -f 
/(a — X) + /(a - 2X).... Sometimes, as with /(a) = (1 + a 2 ) the replication 
sum does not exist; the following is not applicable to such functions. 

If we replicate a function, and then sample, the result is a doubly infinite 
entity 
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■ I ABLE 8 4 

Centroid and mean-square abscissa 
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... 


... + /(.V + 2) +- ... 

• • ■ + f(x + 1 + 2X) + fix + 1 + X) + f(x + 1) 

+ fix + 1 - X) + fix + 1 - 2X) + ... 

• - ■ + f{x + 2X) + fix + X) + fix) + fix - X) + fix - 2X) + . .. 

... + fix - 1 + 2X) + fix - 1 + X) + /(* - 1) 

+ /(.v - 1 - X) + fix - 1 - 2X) + ... 

...+/(*- 2) +... 

shown here in the form of a column matrix, or vector, whose elements are the re¬ 
sulting sample set. 

If on the other hand we propose to sample first, and then replicate, it is nec¬ 
essary first to extend the meaning of replication (introduced above as an opera¬ 
tion on a function) so as to be applicable to a sample set. First restrict the repli- 
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cation interval X to an integer. I et the sample set be /, for —oo < / < oo. Then 
the replicated sample set r ; will be defined by 

r , = • ■ • // + 2X + // + x + f, + f,-x + f j - 2x + ■ • / 

(provided the sums exist). Under these definitions, the replicated sample set is 
the same as the sampled replication. 

An alternative statement of this result uses the equivalence between a sam¬ 
ple set a, and the generalized function ]£,<?,S(.y - /). Sampling at unit interval then 
consists of multiplication by III(.v), while replication at interval X consists of con¬ 
volution with X _1 lll(.r/X). In terms of the sampling operation IIl(v) x and the 
replication operator X ’Ill(.r/X) * , the commutativity property for sampling and 
replication then reads 

X ’III^/X) * [lll(x) X f{x)] = III(at) X [X'’lll(x/X) * f(x)]. 

Referring to Fig. 10.17 may help to illustrate this relation. 


SOME INEQUALITIES 

The discontinuities, cusps, or other sharp behavior characteristics of a function 
reveal the presence of high frequencies in its spectrum; in fact a quantitative mea¬ 
sure of the sharpness of the behavior is linked with the decay of the spectrum in 
another section. Now if a function is quite continuous, with all derivatives con¬ 
tinuous, there is still a limit to the slope, or curvature, which it can have. 

If such a function undergoes a large change in a short interval of abscissa as 
in Fig. 8.11 (that is, it has a very large slope in this interval), it may for some prac¬ 
tical purposes be effectively discontinuous. Its spectrum will indeed be found to 
behave appropriately. Asymptotic behavior appropriate to the continuous func¬ 
tion will ultimately set in, but only at high frequencies beyond the range of 
interest. 

Upper limits to ordinate and slope. Just how steep can the slope of a func¬ 
tion be? Consider first the problem of how great a function can become. We can 
say that 

|/(.v)|< f" \F(s)\ds 

J -OC 

as a direct consequence of the relation 

f(x) = | ‘ F(sY 2 ™ds. 

On the complex plane of fix) a Fourier integral for a particular value of x is 
illustrated in Fig. 8.12. For other values of x the locus would be different but the 
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Fig. 8.11 A continuous function with all continuous derivatives, which for certain 
purposes is effectively discontinuous, and its transform. 


length of the arc, which is equal to 

r mid*, 

J —oo 

must remain the same. This arc length is the maximum value which |/(.v)| could 
assume; and it would do so if there were a value of x for which the arc extended 
into a straight line. In other words, the maximum value of a function cannot ex¬ 
ceed the resultant of all its components at that point, if it exists, where they all 
come into phase together. 



Fig. 8.12 Locus on the complex plane of fix). 
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The slope of the component F(s)exp(i2irxs)ds is 27nsF(s)exp(/27rxs)tfe, and by 
considering the possibilih of all components having their maximum slopes to¬ 
gether, we have 

(/'Ml s 2* jjsF(s)| *- 

The two inequalities we have derived both stem from the geometrical phe¬ 
nomenon that an arc joining two points is equal to or greater than the chord. This 
in turn can be further distilled and depends ultimately on the property that two 
sides of a triangle are together greater than or equal to the third. In vector notation 

|A + B < A + B . 

It appears that inequalities are often reducible to one or the other of a few geo¬ 
metrical inequalities. This particular one is referred to as Bessel's inequality. 


Schwarz's inequality. If two real functions f(x) and tf(.v) are defined in the in¬ 
terval a < x < h, then 

j n /(*)*(*) dx 

A related vector inequality states that the scalar product of two vectors cannot ex¬ 
ceed the product of their absolute values; thus 

A B < AB. 


s I [/(.v)] 2 dx f [y{x)] 2 dx. 

tl J U 


If F and G arc complex functions of x, we have the Schwarz inequality in the 
form most suited to the present work: 

12 


4 | FF * dx | GG* dx. 


j (F*C + FG*) dx 
To prove Schwarz's inequality, let e be a real constant. Then 

0 < f (F + eG){F + eG)* dx, 


because the integrand is a positive quantity (unless bv accident F happens to be 
proportional to G, in which case the value of e that makes F -1- eG identically equal 
to zero must be avoided). By expanding the above inequality we can write 

0 < | FF* dx + t J (F*G + FG*) dx + «r j CG* dx. 

The right-hand side is a quadratic expression in e 2 ; call it c + be + ae 1 . The con¬ 
dition that it should not reduce to zero for any real value of e is b 1 — 4 ac < 0. 

When the Schwarz inequality is applied, definite limits may be assigned to 
the integrals. For example, in connection with the uncertainty relation infinite lim¬ 
its are adopted. The inequality holds, however, for any limits. 
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THE UNCERTAINTY RELATION 

It is well known that the bandwidth-duration product of a signal cannot be less 
than a certain minimum value. This is essentially a mathematical phenomenon 
bound in with the interdependence of time and frequency, which prevents arbi¬ 
trary specification of signals on the time-frequency plane. One may specify arbi¬ 
trary functions of time or arbitrary spectra, but not both together. Thus a finite 
area of the time-frequency plane can contain only a finite number of independent 
data. The bandwidth-duration product of a signal cannot be less than the value 
for an elementary signal containing only one datum. Such a signal may be brief 
and wideband or quasi-monochromatic and persistent. 

Since the equivalent widths of a function and its transform are reciprocals, it 
follows that 

Equivalent duration X equivalent bandwidth = 1. 

The product of the autocorrelation widths is deducible from a previous sec¬ 
tion as 

12 


l/(0)| 2 | } fdx 


} iff 


dx 


and if we deal in mean-square widths, 

/"(0) J *7 A 


= - 


f"(0)F"(0) 


4-7(0)}/* ,6 "‘/(0>F(0) 


Neither of these last two width products is a constant, and the second can range 
from zero to infinity. 

Now consider the energy functions. Let (Aa) 2 be the variance of \f(x)\ 2 and 
(As) 2 be the second moment of |F(s)| 2 , to obtain the usual expression of the un¬ 
certainty relation, namely, 


A.r As > 


4n 


Proof of uncertainty relation. In this section all integrals are to be taken be¬ 
tween infinite limits. We need the theorem 

J /’/'* dx = 4tt 2 J s 2 FF* ds, 

which may be verified by combining the derivative theorem with Rayleigh's the¬ 
orem. 
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We also need the Schwarz inequality in the form 

4 | //* dx | dx > | (/*£ + /$*) dr 
and the formula for integration by parts between infinite limits in the form 

j xf dx - j f dx 

Now, taking/(r), and thus also F(s), to be centered on its centroid, 

(A*) 2 (A$) 2 = 


J x 2 ff* dx 

■ 

s 2 FF* ds 

| ff* dx 

[ FF* ds 


| xf.xf* dx | /'/'* dx 

^ ( j //* 

| (xf*.f + xf.f'*) dx 


I677' 


(f //* * J 




dx 


r=(| ff*dxj 

j //* ‘I 


■a 


1677'[ J f f* dx 

1 

16t r 


Therefore A.v As 2: —. 

477 


Example of uncertainty relation. Take/(.v) to be a voltage V(t) whose Fourier 
transform is S(/). We select V(t) so that its spectrum is real for the purpose of il¬ 
lustration but in general S(/) is complex. Voltages or the fields of electromagnetic 
waves, on the other hand, can only be real. The signal energy distributions and 
the energy spectrum are shown in Fig. 8.13, together with A/ and A/ the root- 
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Energy spectrum 



_JL 

\ 

Centroid of 
energy spectrum 
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energy spectrum 


Df 



f 


Fig. 8.13 The uncertainty relation. 


mean-square departures from the centroids of the two energy distributions. The 
uncertainty relation says that the product At A/ must exceed or equal (47r)^ 1 . In 
terms of angular frequency to. 


A t A to > —. 

2 


Let f(x) = exp (~7rn 2 .v 2 ). Then ff* - exp (~27ra 2 \ J ), for which the variance 
of x is 1 477fl 2 , and so A.y = (4-nY? 2 )’ 2 . Similarly, for the transform, FF* = 
[t? -1 exp ( —7rs 2 /fl 2 )] 2 with variance a 2 / 47r and As = (4 -n/a 2 ) K Hence, for this case. 

Ay As = ~ 

47r 


which is the minimum value permitted by the uncertainty relation in its quanti¬ 
tative form. 
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However, we can make a much stronger statement. Suppose that a radar trans¬ 
mitter emits a 1-microsecond pulse at a frequency of 10,000 megahertz. Then the 
uncertainty principle says that 


10 


-6 


1 


47r X 10 


10 


Now let the positive-frequency power spectrum defined for / > 0 by 2|S(/)| 2 have 
a width D/defined by 


(Df) 2 - 


\y - (f)\ 2 w)\ 2 df 
2 J*[s(0] 2 df 


We know from experience with radio receivers that 

“~W 

since in the case of a 1-microsecond pulse a receiver bandwidth of 1 megahertz 
is an optimum choice for detection. The uncertainty relation thus sets a lower limit 
to the duration-bandwidth product, which in the case illustrated fails by a factor 
of 10 5 to be practical. 

While the positive-frequency energy spectrum is not quite as amenable to 
mathematical handling as S(f), the conventional spectrum in terms of which A/ 
is defined, it is closely connected with what would be observed if the energy spec¬ 
trum were explored experimentally with tunable resonators equipped for energy 
detection. 

The next step is to consider the product 

A tDf, 


which can be shown to agree with experience in cases such as that quoted but 
which is not subject to the lower limit of (47r) 1 applicable to A t A/. Whether the 
product At Df has a lower limit has been studied by Uffink and Hilgevoord 
(1985, 1988). As an example that does not observe the limit consider the 
case of s(t) = exp(--7rf 2 ) cos 27r/ 0 f and its Fourier transform S(f) = 
^exp(—7r(/ + /o) 2 + i exp[-7r(/-/ 0 ) 2 ], where f 0 = 0.218 as illustrated in 
Fig. 8.14. The heavy bars show At and Df Their product equals 0.400 X (l/47r), 
which is well below the quantum limit Af A/. 


THE FINITE DIFFERENCE 

We define the finite difference of f{x), taken over the interval a, to be 

AJM = /(* + |«) - /(* ~ \a)- 



chapter 8: The Two Domains 181 




Fig. 8.14 Illustrating the discrepancy between A/, which is subject to a lower 
limit set by A/Af 1/477, and D/, the width of the positive-frequency 
spectrum, which can be smaller. 


The finite difference is often encountered in connection with functions that are 
tabulated at discrete intervals and so is defined only at discrete values of x. How¬ 
ever, we may also take the finite difference of a function that is defined for all x, 
and in that case the finite difference is also a function of the continuous variable x 


Original 

function 



Fig, 8.15 Finite differences taken over different intervals. 
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When the differencing interval a is small, then A fl /(*) is small but approaches 
proportionality to the derivative; when a is large, \J(:x) may separate out into a 
displaced f(x) followed by an inverted f(x). These possibilities are illustrated in 
Figs. 8.15 and 8.16. 

Since finite differencing in the x domain corresponds to a simple multiplying 
operation in the transform domain, it pays to be alert to the possibility of ex¬ 
pressing functions as finite differences. 

Exercise. Deduce the original functions of which the examples in Fig. 8.17 
arc the finite differences (if possible). Can you say whether your solutions are 
unique? 

Exercise. Discuss the question of whether A „f(x) is an odd function. 

The process of taking the finite difference will be recognized as the equiva¬ 
lent of convolution; that is, 

A./M = 21,M » /(*). 




(a) 





(b) 


Fig. 8.16 Finite differences taken over short and long intervals of (a) rectangle 
function, (b) triangle function. 
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Fig. 8.17 Functions to be expressed as finite differences. 


The Fourier transform of the odd impulse pair has already been discussed; hence 
we know that 

1 /.v\ 

— ill — ) D i sin ttcis. 

1*1 W 

Consequently we have, by the convolution theorem, the following precise con¬ 
nection between the two domains. 


If A ff(x) is the finite difference off(x), taken over the interval a, then the Fourier 
transform of A,/(x) is 2i sin mis F(s). 


Finite differencing thus corresponds, in the transform domain, to multiplication 
by 2 i sin 7 ras. 

Examples given in Fig. 8.18 show how differencing over a wide interval in¬ 
curs multiplication of the transform by a high-frequency sinusoid, but differenc¬ 
ing over a small interval incurs multiplication by a low-frequency sinusoid. For 
a very small interval—for example, one shorter than the scale of the finest struc¬ 
ture in/(x)—the sinusoid becomes effectively a linear function of s. 

The connection with differentiation may be expressed, in the x domain by 


d 

dx 


v A « 
= lim —, 

< 1^0 a 


and in the transform domain by 

2i sin tuis 

lim-= ilirs. 

a 
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Fig. 8.18 Finite differencing corresponds to multiplication of the transform by a 
sinusoid. 


The second difference A 2 aa f(x) is defined by 

AL/M = A a [ A fl /(x)] = /(.v + a) - 2f(x) + f{x - a). 

Since A afl /(x) is obtained by taking the finite difference of the finite difference, it 
follows that it corresponds in the transform domain to two successive multipli¬ 
cations by 2 i sin 7n?s. Hence the Fourier transform of A 2 f(x) is —4 sin 2 ttcis F(s). 

Geometrical interpretations of the finite differences are given in Fig. 8.19. The 
first difference is proportional to the average slope and the second difference to 
the average curvature over finite intervals. 

Exercise. Show that d' dx 2 = a 2 lim A 2 . 

a—>0 


RUNNING MEANS 

In the reduction of meteorological data, such as rainfall data, the unimportant 
day-to-day fluctuations are customarily smoothed out to reveal the meaningful 
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Fig. 8.19 Geometrical interpretation of the first difference of /(*) at x = *i and the 
second difference at x = x 2 . 


seasonal trend by taking running means. The running mean of f(x) over the in¬ 
terval a is defined by 


1 x * 

n v — 


It is quite general practice, when recording data of any sort automatically, to 
smooth out unwanted rapid fluctuations; for example, a signal to be fed to a 
recording milliammeter is often passed through a smoothing filter. The running 
mean is one kind of smoothed value; it is generated by electronic counters that 
integrate an input voltage and print out the result at the end of fixed time inter¬ 
vals. The usual method of integrating a voltage is to apply the voltage to a 
voltage-to-frequency converter and to count the cycles of the voltage controlled 
oscillation over a given time interval 

It is evident that the running mean may be expressed in the form of a con¬ 
volution with a rectangle function of base a and unit area: 



Since the Fourier transform of a n(x/rt) is sine as. the convolution theorem says 
that the transform of the running mean off(x), taken over the interval a, is sine as F(s). 
Thus the process of taking running means corresponds, in the transform domain, 
to multiplication by sine as. 


Exercise. Interpret the properties 

lim sine as = 1 and lim sine as = fl"‘8(s) 

a —*0 n —*0 

in terms of running means. 
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Running means of higher order result from successive applications of the same 
process; thus the second-order running mean 



has a Fourier transform 


sine 2 as F(s). 


Recognizing sine 2 as as the transform of a 1 A (x/a), we note that the second-order 
running mean may be regarded as a weighted running mean generated by convo¬ 
lution with a 'A {x/a). 

A number of successive running means of an original rectangle function, 
shown in Fig. 8.20 together with the successive transforms, illustrate the relation 


A-’n 



* ... n times ... * a 'll 



D 


sine" as. 


CENTRAL-LIMIT THEOREM 


If a large number of functions are convolved together, the resultant may be very 
smooth (Fig. 8.20), and as the number increases indefinitely, the resultant may ap¬ 
proach Gaussian form. The rigorous statement of this tendency of protracted con¬ 
volution is the central-limit theorem. Let us illustrate with an example. 

In Fig. 8.20 two sequences of profiles are shown, each approaching Gaussian 
form in the central part as n —►oc. Over a small range of s around s = 0 the top 
right-hand profile sine s is approximated by the parabolic curve 1 — ms 2 , and 
therefore the nth profile is approximated by (1 — ms 2 )". Now 


(1 - ms 2 )" = 


1 — nms~ + — 


»(» - 1) 


1.2 


m 2 s 4 


1 - nms 2 + 


n 2 m 2 s 4 
^L2 


_ „ tints 


= C 


+ remainder. 


+ remainder 


Keeping s fixed and letting n tend to infinity we see that we have a Gaussian term 
which continually gets narrower, its width varying as plus a remainder of di¬ 
minishing relative importance. The central curvature of the right-hand profile in¬ 
creases proportionally to ii. 

The Gaussian term has a Gaussian transform 

(—V ’ rv/ "' n , 

\ 11 / 11 / 
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Fig. 8.20 Successive running means and their transforms. 


which continually gets wider, the variance increasing proportionally to n; 
this, of course, is a consequence of the property that variances add under con¬ 
volution. 

The interesting phenomenon is the tendency toward Gaussian form under 
successive self-convolution and also under successive self-multiplication. 


Exercise. Graph cos in s and [/o(s)] 10 for small s. 

How the remainder term behaves in general is discussed by Khinchin (1934), 
and obviously not all original profiles lead to the Gaussian result under contin¬ 
ued self-convolution; for example, I I (x) sin 2-ir.r does not. However, the functions 
which do manage to smooth themselves out into regular Gaussian form are nu¬ 
merous and include unsymmetrical functions such as e 'H(x) and rather unlikely 
looking discontinuous functions, such as n(.\). Even n(x), which has two infinite 
discontinuities, comes close. The sometimes surprising rapidity with which the 
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approach to Gaussian form sets in is interesting to investigate numerically bv trial. 
(For example, form the successive serial products {1 1}*", {1 1 1 1}*", 

{3 2 1}*", and test by plotting the logarithms of the terms against the square 

of the distance from the center.) 

The central-limit theorem in its general form states that under applicable con¬ 
ditions the convolution of n functions (not necessarily all the same as in the dis¬ 
cussion above) is equal to a Gaussian function whose variance is the sum of the 
variances of the different functions, plus a remainder which diminishes with in¬ 
creasing n in a certain way. 

Without studying at length the conditions of applicability, we can see that the 
essential thing is that the Fourier transform of each of the functions entering into 
the convolution should exhibit the humped kind of behavior at the origin, which 
is possessed by our example; that is, it should be of the form a - frs 2 . The quan¬ 
tity o must not be zero; that is, no one of the n functions may have zero area, or 
else the product of the transforms will be zero at s = 0, and the total convolution 
will be reduced to zero area. Similarly, it must not be infinite. It does not matter 
if b is occasionally zero, but it should in no case be infinite. Clearly, nothing 
resembling A(s) at the origin should be included, for one such factor would 
leave a permanent corner at the origin, thus preventing approach to the Gauss¬ 
ian form. 

It is not necessary that all the transforms have zero slope at the origin, but 
this could always be ensured by referring each function to its centroid, provided 
that the slope was not infinite. 

The conditions may be expressed in the x domain as follows. First consider 
the case of identical real functions f(x), 

/(.Y)*/(.Y)* ... */(*), 

and eliminate the possibility of/(.Y) having negative area. Then the first condition 
(a =£ o or oo) becomes 


0 < | /(:y) dx < oo. 

The condition on F'(0) becomes 

x/(x)c/t = 0. 

The requirement that F(s) have a finite nonpositive second derivative (b finite) be¬ 
comes 


0 < 



dx < oo. 


The possibility should also be considered that there is a discontinuity in the sec¬ 
ond derivative; but if f(x) is real, the real part of F(s), being even, must have the 
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■ TABI E 8.5 

Table of correspondences 


I ' f(x)dx - /(0) 

f' no) 

L x ' Mdx= ^ 
F ' {0) 

*’ 2 iriF(O) 


Area equals central ordinate of transform 
f irst moment oc central slope of transform 

Abscissa of centroid a central slope over central 
ordinate of transform 



Second moment a central downward curvature of 
transform 


Mean-square value of x oc central curvature over 
central ordinate of transform 

{x) f . x = {x) f (x\ Abscissas of centroids add under convolution 

(x 2 )).^. = (x 2 ) f + (r 2 )^ Mean-square abscissas add under convolution 

irj.y = <t) + (T 2 Variances add under convolution 

If the <cth deriv ative of f(x) becomes impulsive, F(s) — )s| k . 

If the with derivative of /(.v) and the nth derivative of y>(.v) become impulsive, the (m + ti)th 
derivative of / * t; becomes impulsive 


<**>=- 


47T J /(0) 



T'he equivalent width of f(x) is its area over its central 
ordinate 

The equivalent width of a function is the reciprocal of 
the equivalent width of its transform 


l/(- r )l 5 ) F(s)| ds Maximum possible magnitude 

|/'(x)| 2tt | |jF(s)| ds Maximum possible slope 

(J/MkM dxf s /[/(rtf dx /[^(r)]- dx Schwarz's inequality 

1 . 

a t ctT, & - — Uncertainty relation 

477 


A/(x) = 2t|(.r) * f(x) Finite differencing is convolution with odd impulse pair 

A/(x) O 2i sin 7 t<js F(s) Finite differencing over interval a corresponds, in the 

transform domain, to multiplication by 2 i sin ms. 

(Note: Differentiation corresponds to multiplication by 
Hits.) 

a 1 nf — ) » f(x) D sine as F(s) Taking running means over interval a corresponds to 

multiplication by sine a* 

Mm/, * f 2 * ■■■ */„ = <’ JX The convolution of many functions approaches 

Gaussian form, provided that their transforms are 
humped at the origin (centrai-limit theorem) 
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same curvature to each side of the origin. Therefore any discontinuity must be 
confined to the imaginary part of F"(s). But the imaginary part of F(s) is zero at 
s = 0; therefore any effect of a discontinuity in F''(s) at s = 0 will die out in the 
limit. It is therefore sufficient to require f(x) to have finite area, finite mean, and 
finite variance. 

In the event of nonidentical functions being convolved, a finite absolute third 
moment is required plus a more elaborate condition due to Lyapunov to ensure 
that the third moments are not too strong. 

Exercise. Consider the behavior of (sine .v)*", (sine 2 x)* n , [(1 + v 2 ) l ]*", 
[jrFI(jf)]*", [n(.v) sin ,v]* n , [r ,1X sin /3\H(x)]*". 

If one of the transforms falls to zero for some finite value s = s, the product 
of all the transforms will have a zero too, and so their product cannot be Gauss¬ 
ian. Therefore none of the convolving functions of v mav be a rectangle function. 
This may be a moot point because the transform values of the full convolution 
may be so close to Gaussian for s > s, that a zero value is indistinguishable from 
the exact Gaussian value for some intents and purposes. This is the case with 

[n(x)]*«. 


SUMMARY OF CORRESPONDENCES IN THE TWO DOMAINS 

The results of the preceding discussion are tabulated in Table 8.5 for reference. 
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PROBLEMS 


1. Deduce a simple expression for exp (— x 2 ) * exp (—.t 2 ). D> 

2. Show that the self-convolution of (1 + .t 2 ) - ' is identical with itself, except for scale fac¬ 
tors. Show that the self-convolution is twice as wide as the original function, that is, 
that the width is additive under convolution in this case, and reconcile this with the 
known general fact that variance is additive. 

3. Investigate the functional form of (1 + x 2 //! 2 ) 1 * (1 + x 2 /bi 2 ) and its width in terms of 
the widths of the convolved functions. 


4. Show by direct integration that 


A<x)H(r) D 


1 

i2irs 


e m f sine s 
t2ns 


verify the result by applying first the addition and shift theorems to find the Fourier 
transform of (d/dx)[ V(.v)H(.v)], and then the derivative theorem in reverse 


5. By separation of the preceding transform into real and imaginary parts, show that 

A(x)H(x) D \ sine 2 s +---■; 

iZtts 

as checks on the algebra, verify that the central ordinate and slope are connected in the 
appropriate wav with the area and first moment of A (x)H(x), respectively, and note 
whether the transform is indeed hermitian. Break \{x)H(x) into its even and odd parts, 
and obtain the transform of each separately. 

6. Because of the irregular variation in the number of sunspots, the sequence of daily 
sunspot numbers is smoothed by taking five-day running totals; that is, for each day 
we add the sunspot number for the preceding and following two days. Here is a se¬ 
quence of five-day running totals beginning Jan. 1, 1900: 

45, 35, 25, 15, 5, 0, 0, 0, 0, 15, 50, 80, 100, 125, 125, 100, 80, 70, 45, 30, 30, 30, 35, 60, 80, 
90, 95, 100, 90, 85, 75. O 

From this smoothed sequence, what can be deduced about the actual daily values? 

7. Show that 




w = ——?■ 

* w 

vy fx 


where IV, is the equivalent width of f(x). 


8. Show that squares of equivalent widths are additive under convolution of Gaussian 
functions. 
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9. Show that the equivalent width of 4 sine 2 2s - sine 2 s is ], and calculate the equivalent 
width of sine s + sine 2 2s. 

10. Investigate the properties of the Jones bandwidth of f(x), which is defined as 

f ' FF* ds 

h -> 

Fnux 

11. Show that the autocorrelation width of f(x)H(x ) is twice that of f(x). 

12. Verify the following autocorrelation widths. 

Function: xlT(.* - \) n(2* + |) + n(Zv - 2) 

Width: £ 1 2n'rr 

13. The abscissa x of a function/(x) is divided into a finite number of finite segments (plus 
two semi-infinite end segments). The finite segments are rearranged without overlap¬ 
ping, thus defining a new function which we may describe as derivable from f{x) by 
shuffling. For example, the string of 11 pulses 

2) no 1 * -») 

«=* -5 

and the function |ar|n(x/2) are derivable respectively from n(x) and V(x) by shuffling, 
and vice versa. Show that the equivalent width is unaffected by shuffling if the segment 
containing x — 0 is not dislodged in the shuffle, and that the autocorrelation width is 
not affected in any case. Consider the effect of shuffling on the total energy of a wave¬ 
form, and mention several parameters of its power spectrum which are invariant un¬ 
der shuffling. C> 

14. An even function g(x) is derived from a function f(x) by the process of symmetrization 
illustrated in Fig. 8.21, where AB = CD, EF = GH + If, and so on. This process, known 



Fig. 8.21 Steiner symmetrization. 
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as Steiner symmetrization, was used by Jacob Steiner to prove that the circle is the fig¬ 
ure of minimum perimeter for a given area. Show that the autocorrelation functions of 
/(.r) and g(x) have the same equivalent width. 

15. State the relationship between the functions exp (-x)H(x) and exp(— |x|) in the light 
of symmetrization, and say how their respective power spectra are related. > 

16. Show that the convolution of two odd functions is even. 

17. Establish the following relations between functions and their autocorrelation functions. 


Function 

Autocorrelation 

n(r) 

AM 

e~’"‘ 

2-^-1”' 

S(x) 

«M 

e 'H(x) 

\e ‘ 


e X <1 + i*l) 


18. Show by a simple argument in the Fourier transform domain that the autocorrelation 
function of exp (— nx 2 ) cos wx is 2 32 exp (— {nx 2 ) cos cjx when w is large. > 

19. Some difficulty arises over the autocorrelation of cos x. Show that there is a sense in 
which the autocorrelation of a cosine function is also a cosine function. 


20. Show that the product of the autocorrelation widths of a function and its transform is 
given by 




Ufdx)\fFds) 2 


(ff ? dxf 

and that the product does not have a nonzero lower limit- 

21. Show that 


|/**l« [ ' |FC| ds. 

J — oo 

22. Self-reciprocal transform. We know that there is at least one function /(.) that is its 
own Fourier transform F(.), because 

-j 


It is reported that 


/( x) = + 5e"" (5lf 


is another function that is its own Fourier transform, that is, that F(s ) = /(s). Can you 
prove or disprove this claim? 
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23. Wavepacket spectrum. Show that 


exp (-/3x 2 ) cos ax D 




cosh 

V (i 


( 


24. Surfing. There is a tradition in surfing communities that every seventh wave is bigger. 
What would be the corresponding feature in the wave-spectrum domain? 

25. Hermite polynomial pairs. Derive the following Fourier transform pairs 

D -1ST 

(477V 2 - iy«* D -(477S 2 - 1 y™ 

(47T.V 3 - 3-vV^ r ' D 1(4775" - .'fey-'* 1 
(167rV - 2477V 2 + 3y“* D (1677 2 s 4 - 2477S 2 + 3)c “* 

and, in general, 

H„(\/277 vy^ => (-/[)"H„(\/2^sy ■»’, 

where H„(.v) are the Hermite polynomials 1, 2x, 4V 2 - 2, St 3 - IZv, 

16v 4 - 48.V 2 + 12, n = 0, 1,2, ... 

26. Computed music. Describe how it might be possible to generate a sound of perpetu¬ 
ally rising pitch that never rises beyond the range of audibility. E> 

27. Acoustic perception. A musician with his back to a violinist is able to tell whether the 
player is slow'ly moving away or is playing diminuendo. On being questioned about 
his ability, the musician explained, “The violinist may play a single tone loudly or 
softly and maintain steady tone quality, but as he moves away while sustaining a sin¬ 
gle note, there is a clear change in the color of the note. It sounds purer—the overtones 
less prominent." An acoustics engineer said, “When you hear a click it is followed bv 
reverberant energy that arrives after reflection from the walls. The same click farther 
away sounds fainter but the amount of reverberant energy entering the ear is about 
the same. Therefore, the subjective impression is not the same as for a faint nearby 
click. Since the impulse response is different, naturally the violin note sounds differ¬ 
ent." Explain how this explanation, if it is correct, is consistent with the musician's 
explanation. 

28. Central slope of transform phase. l et <f>(s) be the phase of the Fourier transform F(s) 
of a given real function f(x). Show that, if <fr(s) passes through the origin, it dot's so with 
a slope 


<t>'(0) = -2tt | ^ xf{x)dxj | f{x) dx. 

Verify the result for the case where f(x) = at 'H(v). 

29. Restoration for running means. Suppose that we are given g(x), a function that results 
from smoothing f{x) by convolution with a rectangle function ri(v). Thus 
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g(x) = ri(x) * f(x). We wish to find f(x). See whether you can find an inverse operator 
n '(.t) such that n '(*) * n(r) = 8(x) or whether you can find a Fourier transform for 
(sine s) V > 

30. Restoration for weighted running mean. Attempt to find an inverse operator for run¬ 
ning means taken with triangular weighting. Thus if 

£(x) = A(x) * /(.v) 

seek \ '(.r) with the property that, ify(.v) is given,/( a) may be found bv performing the 
inverse operation: /(.v) = \ '(a:) * £(.r) If this approach works, it will be necessary that 
\ '(.v) * A(.v) = 5(x) It has been proposed that 

fix) = s"(x - 1) + 2 g"(x - 2) + 3 tS >"(;r - 3) + ... 

Examine this formula for some special case by graphing the first two or three terms and 
attempt to derive it. 

31. Moments. Determine constants a, b, and c such that f(x) = a + b cos 2-ncx is a good 
fit to sine x over the range -1 < x < 1. In what way could F(s) be said to resemble 
n(s)? 

32. Sine function properties. From p 75 of Abramovit/. and Stegun (1964) we discover that 

sinc *- n(’-5) 

We may think of each parabolic factor progressively forcing the product through 
.r = l,2, ...,»!. Show that the coefficients in the expansion of (1 - x 2 ) 
(1 - x 2 /4)(1 - x*/9) do not agree with the coefficients of the Taylor series expansion of 
sine .r. Why is that? Why does the central limit theorem not seem to apply? t> 

33. Dual lines of reasoning. Problems that are stated in the time domain and require 
answers in the frequency domain can be reasoned out in either of two ways: Translate 
the statement into the frequency domain and find the answer to the new question, 
or solve in the time domain and translate the answer into the frequency domain. Con¬ 
sider the following problem. "A short pulse has a more or less flat spectrum up to a 
roll-off frequency that is some fraction of (pulse duration) *, but is it true that the spec¬ 
trum of a waveform consisting of two identical pulses in succession, far from being 
approximately uniform, is such that there are frequencies where there is no content 
at all?" 

A line of reasoning leading to this result is as follows: "The pulse pair is express¬ 
ible as a convolution between the waveform of a single pulse and an impulse pair 
2^(0 + 2 ^(f ~ T), where T is the interval between pulses. Consequently, its spectrum 
contains a factor cos irTf, which produces zeros at certain frequencies." The problem 
did not require the full spectrum to be calculated and did not ask for the values of fre¬ 
quency at the zeros, but as with many important questions, was merely concerned with 
whether a certain phenomenon existed Consequently, the reasoning presented can be 
brief. Now give the other line of reasoning leading to the same result. 



1% The Fourier Transform and Its Applications 

34. Variance of wavepacket abscissa. Derive the variance (x 2 ) of the wavepacket 
f(x) = exp[-7r(.v/W) 2 ]cos27re.r. t> 


35. A function consisting of an asymmetrical triangular peak, with its reflection, is defined 
by 

f fr|x|, 0 ^ |a | < a 

/(v) = < 1 ~ \x\, a « \x\ < 1 
[O, |x| > 1 

where k and a lie between 0 and 1. Find its Fourier transform F(s). C> 


36. Radar pulse generator. In order to deliv er a megawatt of radio frequency power out¬ 
put to an antenna in a pulse of A = 0.1 fj .s duration, a generator has to be excited at its 
input terminals by a voltage 15,00011(1 — 'A) volts. A way of doing this would be to 
spend a millisecond or so charging one conductor of a transmission line to a steady 
voltage of 30 kV. The characteristic impedance Z ( , of the transmission line would be 
made equal to the input resistance of the generator. At 1 = 0, a switch would connect 
the charged transmission line to the generator, applying 15 kV to the generator input 
Electric charge would pour from the transmission line at a constant rate for 0.1 /xs un¬ 
til the total charge was expended, w hereupon the generator excitation would drop to 
zero and the r.f. pulse going to the transmitting antenna would terminate, (a) What 
would the length of the transmission line have to be (in meters)? ( b) As seen from the 
generator, what would be the input impedance to the transmission line segment and 
the voltage transfer function, as a function of frequency? (c) What would the impulse 
response of the transmission line segment be? t> 

37. Functions to be expressed as finite differences. Do the exercise relating to Fig. 8.17. > 

38. Keeping up with periodicals. Scan recent issues of journals in the current field of 
study, find a paper that interests you, and submit a synopsis in a form that would equip 
your instructor to give a 10-minute talk to the class about the work without having to 
refer to the original paper. 

39. Composing a homework problem. Compose a homework problem suitable for your 
class and hand it in together with a solution suitable in final form for distribution. Bear 
in mind the distinction between a problem and an exercise. 

40. Schrbdinger's equation. A basic principle of quantum mechanics, applied to the har¬ 
monic oscillator composed of a mass m constrained by a spring of stiffness k, says that 
the spatial wave function tfi(x) (whose squared modulus gives the relative proba¬ 
bility of finding the mass in position x ± [dx ), obevs the second-order, linear differen¬ 
tial equation 


fi d 2 tji . 

~ + E*-W0. 



Chapter 8: The Two Domains 


197 


Solutions, for the various allowed energies £„ = tiuj{n + [),n = 0, 1,2,... are 

= V a/X n2"n ! H„(ax)e~ aX ‘ l2 l 

where o? = k/m and a = (mk/h) yA . The H„ are the Hermite polynomials listed above in 
Problem 8.25, where the Hermite-Gauss functions H„(x) exp(— x 2 /2) can be seen to be 
their own Fourier transforms. That seems to imply that if one takes the Fourier trans¬ 
form of this Schrodinger equation term by term, the resulting differential equation for 
the transform 'I' must still be a Schrodinger equation. Is that so? D> 



■in 

Waveforms, Spectra, Filters, and Linearity 


In this chapter the response of a linear system, such as an electrical filter, is con- 
sidered from the point of view of resolution of the input into exponential, or har¬ 
monic, components, and an equivalent way of looking at filter action in the time 
domain is exhibited. The fundamental connections between linearity and convo¬ 
lution are also derived. 


ELECTRICAL WAVEFORMS AND SPECTRA 

An electrical waveform V(t) is a single-valued real function of time t subject only 
to the general requirement of representing physically possible time dependence. 
Yet it is firmly established usage to speak as though steps, impulses, and ab¬ 
solutely monochromatic signals were electrical waveforms, even though it is 
clearly not possible to generate discontinuous, infinite, or eternal currents or volt¬ 
ages. When wc make statements about the behavior of circuits in the presence of 
steps or impulses, we imply that a more rigorous statement exists in which that 
behavior would appear as the limiting form of behavior under a sequence of stim¬ 
uli approaching a discontinuous step or infinite pulse. The same applies to state¬ 
ments about behavior in the presence of alternating or direct current. 

The spectrum S(/) of the electrical waveform V(f) is defined as its Fourier 
transform (or transform in the limit as necessary): 

S(/) = f " V(t)e-' 2nfl (It 

J “OC 

whence V(t) = [' S{f)e' 2nfl df. 

J “W 
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Since V(f) is by definition restricted to real functions, S(/) is also subject to a 
restriction on its generality. The real part of a spectrum function S(/) must always 
be even and its imaginary part odd (see Chapter 2); that is, S(/) is hermitian. 

Waveforms may also be subject on occasion to special restrictions of which 
some of the most common are given in Table 9.1. 

The transform formulas for waveforms and spectra have been written in sys¬ 
tem 1 of Chapter 2. They are sometimes written in system 2 and then appear as 

S(w) = T V(t)e' w, dt 

J -OO 

V / (0 = 7-f' S(io)e“ u ‘clw 
Ltt J -oo 

The substitution of to for 2irf introduces the coefficient 1/27T, which, of course, 
may be written in front of either integral according as A' and s in the system 2 for¬ 
mulas are identified with t and to, or vice versa. The form given here is widely 
used, some users remembering the location of the unsymmetrical coefficient by 
the fact that if the factor dio/lir were replaced by df the formulas w'ould be sym¬ 
metrical. The fact that the system 1 formulas are unchanged on generalization to 
more than one dimension carries no weight in circuit theory, where t has no higher- 
order generalization. 

One also encounters the symmetrical system 3, in the form 

S(o,) = ^r7f ' v (')p "" dl 

v(t) = 7T3 f" 

(27t) ' x 

The waveform V(t) may be a train of impulses of varying amplitude. In particu¬ 
lar, the impulses may be regularly spaced, occurring at times t = l, with strengths 


■ lablc 9.1 

Corresponding restrictions 


Restriction on waveform 

Restriction on 
spectrum 

Real 

Im V(t) = 0 

Re S(/) even and Im S(/) odd 

Switches on 

V(t) = 0 t < 0 

1m S(/) is 1 filbert transform of Re S(f) 

Nonnegative 

V'(f) => 0 

Complicated 

Finite energy 

j ' V 1 dl = IV 

| ’ SS* df = w 

Finite duration 

V{t) - 0 |(| > T 

S(/) fully determined bv III(7jf)S(/) 

Band-limited 

1/(0 full) determined by III(A4/)l/(f) 

S(f) - 0,1/ - f„\ * M 
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a„ where i and t, are integers. Normal continuous-time theory will then cover sig¬ 
nals representable by the sequence of coefficients {fl,} and directly generate the 
subject matter of digital signal processing (DSP). 

An interesting pair of formulas with total symmetry was proposed by Hart¬ 
ley (1942): 

1 ( °° 

=- 7 1 y(f)(cos cot + sin cot)dt 

(2tt)' } 

1 f°° 

V(f) —- 7 tf/(co)(cos wt + sin cot) dw. 

(2tt )»J-“ 

It is evident that cos u it + sin u>f is a Fourier kernel, as defined in Chapter 13. 
The Fourier theorems have counterparts (Chapter 12) and the fast Hartley algo¬ 
rithm has been explored in hundreds of papers since 1983 (see Proc. IEEE, vol. 82, 
March 1994, for a special issue with bibliography). 


FILTERS 

We shall use the term "filter" here to denote a physical system having an input 
and an output. Other equivalent terms are transducer, fourpole, four-terminal net¬ 
work, and two-port element. Although electrical terminology will be used, the 
present considerations will usually apply to mechanical and acoustical transduc¬ 
ers and to equivalent devices in other fields where vibrations or oscillations are 
transmitted. Of course, even within the electrical field, filters may assume a wide 
variety of physical embodiments, from clusters of wire coils and capacitors to in¬ 
tricate geometrical structures in waveguide. 

When a waveform A cos 2-irft is fed into a linear time-invariant electrical fil¬ 
ter, the output is also harmonic, as will be proved later, but has in general a dif¬ 
ferent amplitude and phase; let it be B cos (27r// + <t>). Then the filter is com¬ 
pletely specified by a certain frequency-dependent complex quantity T(/), whose 
amplitude is given by B/A and whose phase is <^>; thus 

T(f) = 

We refer to T(/) as the transfer factor, transfer function, system function, or fre¬ 
quency response of the filter. 

When an input V t (t) is applied to the filter and it is desired to calculate the 
output V 2 (f), one analyzes V,(f) into its spectrum, multiplies each spectral com¬ 
ponent by the corresponding transfer factor to obtain the spectrum of V 2 (f), and 
then synthesizes V 2 {t) from its spectrum. Thus 

S 2 (/) = T(/)S,(/), 
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and then V\(f) = J ' T(f)S l (fy 2n( ' df. (1) 

Since multiplication of transforms corresponds to convolution of original func¬ 
tions, it follows that V 2 (t) may be derived directly from V t (f) by smoothing with 
a certain function which would be characteristic of the filter, that is, 

V 2 (t) = /(f) * V ,(f). (2) 

where /(f) is the Fourier transform of T(f). 

These two procedures are shown schematically as follows: 

V,(f)—transform—>S,(/) V,(f) 

I I 

multiply by convolve with 

T(/) /(f) <— transform — T\(f) 

i i 

V 2 (f) <— transform — S,(/) V 7 2 (f) 

Combining all the quantities into one diagram with time functions on the left 
and transforms on the right in accordance with the convention, we can summa¬ 
rize the interrelations concisely as follows: 


Vi{l) 

D 

?.(/) 

convolution 


multiplication 

m 

D 

T(f) 

i 


i 

v&) 

D 

s*f) 


The characteristic waveform /(f) associated with the filter is seen from (1) to 
be the Output obtained when S t (f) = 1, that is, when l/,(f) = /5(f). It is known in 
communications as the "impulse response" of the filter. For many purposes it is 
as useful as the frequency characteristic /'(/) as a means of specifying a filter, and 
it may be much easier to obtain experimentally. Equation (2) simply breaks up 
V,(f) into a sequence of impulses and expresses V 2 (l) as a sum of the responses 
for each component impulse. 

A third means of specifying a filter is by its "step response," that is, the out¬ 
put corresponding to the switching on of a constant signal V,(f) = H(f). Call this 
response A(t). Then, regarding Vj(f) as broken up into a sequence of steps 
V' l (T)H(t — t), we have 

VA(f) = A(t) * V\(t). (3) 

Transforming this relation and comparing with (1), we have the relation of the 
step-function response to the transmission characteristic of the filter: 

S 2 (f) = A(/)/27r/S,(/); 


(4) 
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therefore T{f) = i2nfA(f), 

whence by a further transformation we have the relation between the step- 
function response and the impulse response: 


Retransforming (4) with a different choice of factors, we may obtain 

V 2 (t) = A'(t) * 

or formulas involving higher derivatives and integrals, including those of frac¬ 
tional order. 

Figure 9.1 shows the relationships involving the step response A(t). 

The procedure with filters is summarized in the following table. 

which has the 

Analyze input into Specify filter by Fourier transform 

Sine and cosine waves Transmission characteristic T(f) t(t) 

Impulses Impulse response 1(f) T(f) 

Steps Step response A(t) T(f)/2mf 

The Fourier integral thus arises in filter theory in any of the following forms: 


v<0 = [” 

J “00 

'(')= f“ UfyW'df 

J ~<> 





and the convolution integral occurs in 


V 2 (t) = [ X I(t- r)V,(r)d T = /(f) * V x (t) = A\t) * V,(t) 

} -oo 

V 2 (t) = f" A(t - r)V\(r)dr = A(t ) * V\(t). 

] -ot 


v ,(0 

Differentiation 

VV(0 


s,(/) 

Multiplication 
by i2irf 

i'27t/S 1 (/) 


Convolution 

with 

no 


<— 

Differentiation 


Convolution 

with 

A(f) 



Multiplication 

by 

T(f) 


Multiplication 
by il-nf 


Multiplication 

by 

T(f)/i2nf 



Fig. 9.1 Operations involving the step and impulse responses, and corresponding 
operations in the transform domain. 
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GENERALITY OF LINEAR FILTER THEORY 

Throughout this section the symbol V has been used for both input and output, 
but the discussion is not limited to electrical quantities. Not only are mechanical, 
acoustical, and optical interpretations included but the input may be a voltage 
and the response may be a current, or vice-versa. When referring to the current 
response to voltage excitation, T(f) has the established name transfer admittance, 
while transfer impedance applies to voltage response to applied current. The term 
transfer factor thus includes transfer admittance and transfer impedance as well 
as the dimensionless factor that applies when V 2 (t) and V,(f) are both voltages or 
both currents. Although the word "transfer," as in transfer admittance, is intended 
to cover cases where excitation at one point produces response at another point, 
nevertheless transfer factor does include response measured at the point of exci¬ 
tation. Transfer admittance thus includes the simple admittance at a point. 

Velocity/force, flow/pressure, electromagnetic field ratios and related ratios 
in other subjects where linearity prevails are all covered by the foregoing section, 
provided time invariance (see below) also applies. 

Digital signals consisting of sequences, or arrays of data such as 
{1 2.7 7 4 20 1 ... }, are equivalent in information content to impulsive functions 
of continuous time, in this example 8 (f) + 2.78(t — 1) + 7.48(t - 2) + 
20.1fi(/ — 3) + .... Thus discrete-time signals are included in the theory of this 
section. When it comes to numerical work, however, the practical operations are 
different, reducing to the convolution sums described in Chapter 3. The situation 
is analogous to the computation of an integral by summing discrete values, a pro¬ 
cedure that is different from the evaluation of integrals by analysis. 

Filters that are used in digital signal transmission for noise reduction, sharp¬ 
ening, ensuring conformity with spectral allocation, synchronizing clock circuits, 
and other purposes are apt to be made of electrical conductors, semiconductors, 
and dielectric materials configured to perform as resistors, inductances, capaci¬ 
tors, and active circuit elements. For the theory of networks of such elements the 
circuit diagram is an indispensable tool. The circuit diagram, by origin a me¬ 
chanical drawing of a schematic kind showing the layout of coiled wires, spaced 
condenser plates, terminal posts, and connecting wires, no longer stands for a 
physical device at all; it stands for a set of differential equations. This is well il¬ 
lustrated by the migration of the circuit diagram from electrical engineering into 
acoustics and mechanical vibrations. The act of abstracting the diagram from the 
physical device requires understanding of the physics. 

Once the abstraction is made, the resulting mathematical model may be han¬ 
dled without further reference to the physical world. Signal theory is on a further 
level of mathematical abstraction w'here the differential equations are tucked in¬ 
side black boxes and replaced by overall operators. The interconnections of sig¬ 
nal generators, filters, transmission and feedback systems, detectors, and so on, 
may then be represented by a flow diagram. Though clearly descended from the 
circuit diagram, the flow diagram suppresses circuit concepts in favor of overall 
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operations, such as the matrix operations that are a staple of digital signal pro¬ 
cessing theory, and is thus twice removed from manufacturing reality. 


DIGITAL FILTERING 

Discrete-time signals, where time t assumes integer values, can arise as regular 
samples of a continuous-time signal V(t). The resulting sequence f{n), where n is 
an integer, is then an approximate representation of an underlying "true" signal 
V(l). This does not mean that/(») is inferior to V(t)- on the contrary, the measured 
values such as /(»;) are a basis of our knowledge about V(t). 

The sampling device contains a clock that connects V(t) to a capacitance for 
a short charging time, and the voltage that builds up by the moment of discon¬ 
nect is digitized and recorded. This is the sample-and-hold circuit. An apparently 
indirect method that is often preferable is to connect to a voltage controlled os¬ 
cillator for a short time while passing the signal to a counter that counts the os¬ 
cillator cycles; the count is then recorded. Whatever the device, a sample is of ne¬ 
cessity a weighted average over a finite time. 

Other discrete-time signals, such as daily counts of landings at an airport, or 
daily rainfall values, are not samples of any underlying continuous-time function; 
the discrete-time signal exists in its own right. 

Discrete-time signals f(n), regarded as input signals, are often subjected to fil¬ 
tering: low-pass filtering is applied to reduce unwanted random noise or rapid 
systematic fluctuations, high-pass filtering reduces unwanted drifts, and preci¬ 
sion filtering is applied to digital signals to meet legal requirements on bandwidth 
that apply to telephone lines and wireless transmission. 

The filtering operation is one of convolution with a desired discrete-time im¬ 
pulse response h(n) which, in many cases, is arrived at as the Fourier transform 
of an imposed frequency response. Calling the output signal g(n) we have the con¬ 
volution sum 

g(ti) = h(n) * /(>»), 

which may be compared with the continuous-time convolution integral 

V 2 (t) = 1(f) * V,(t). 

Chapter 3 has dealt with the machinery of discrete convolution. Chapter 13 
discusses the equivalent z-transform notation that is favored in control system 
analysis. In theory, an impulse response h(n) might have an infinite number of 
terms; where there is room for misunderstanding, the term "finite impulse re¬ 
sponse" (FIR) filter is available, but in numerical computing it goes without say¬ 
ing that impulse responses have a finite number of terms. 

If a discrete-time signal f(n) had to be filtered by convolution with a contin¬ 
uous-time impulse response 1(1) such as e 'H(t) one could readily evaluate, or 
graph, V 2 (^) = I(t) * [X/(»»)£(f — »)]/ but *be output V 2 (/) would no longer be a 
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Fig. 9.2 (a) The continuous-time impulse response /(f) = e 'H(f) and its samples 

h(n) at integer values of t. (b) An input /(h) = {12 1} elicits three re¬ 
sponses, e 'H(f), 2e ,f "//(f - 1), e <f ~ 2) H(f - 2), (light curves) that sum 
to V 2 (f) ( heavy curve). The samples of V 2 (f) are identical with 
#(h) = h(u) */(«). 


discrete-time signal. The normal procedure would be to convert /(/) into a 

discrete-time impulse response h(n) given by h( 0) = 0.5, h( 1) = c h( 2) — e 2 , _ 

The initial value /i(0) is chosen as the mean of 1(0-) and /(0 + ). 

Example. Given the foregoing h(n) and taking f(n) = {1 2 1}, 

g{n) = {0.5 e ’ e 2 e -3 ...} * {1 2 1} 

= {0.5 1.37 1.37 0.69 0.25 ... }. 

The equivalence of a data sequence and the corresponding continuous-time im¬ 
pulse train is illustrated by noting that the values of g(u) are the same as the sam¬ 
ples of V 2 (t) at integer values of t (Fig. 9.2). 


INTERPRETATION OF THEOREMS 

All the theorems concerning functions and their Fourier transforms which were 
dealt with in Chapter 6 are interpretable in relation to waveforms, spectra, and 
filters. For convenience the theorems are gathered in Table 9.2 for reference, in 
the symbology appropriate to this chapter. The first four theorems are discussed 
below. 

Similarity theorem. The reciprocal relationship of period and frequency is ev¬ 
ident in this theorem, for compression of the time scale by a given factor com- 
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■ Table 9.2 

Theorems for waveforms and their spectra 


Theorem 

Waveform V<f) 

Spectrum S(/) 

Similarity 

V{at) 

±s(l) 

W W 

Addition 

VM + v 2 (t) 

s.(/) + «/) 

Shift 

V(t - T) 

e-^Sf/) 

Modulation 

V/(f) cos cat 

H/-s) + H/ + 5) 

Convolution 

/(0 * v m 

T(f)SUf) 

Autocorrelation 

vwvA-i) 

|S (/)| 2 

Differentiation 

V'{t) 

v"(0 

>2 irfS(f) 

—4ir 2 / 2 S( f) 

Inverse 

fV(t) 

f J V(f) 

~S'(f)/i2n 

-S"(/)/4t7 2 

Finite difference 

AV(f) = V(t + 1 T) - V(f - ^T) 

2i sin vT / S(/) 

Second difference 

A 2 V(t) 

—4 sin 2 nTf S{f) 

Running means 


sin 7 t/T 
rr/T 

Rayleigh 



Energy 

f" v,(0v 2 (/)df = f~ s,s;a/ 

1 -« J “*X> 


Definite integral 

V(t)dl = S(0) 

J -IX» 


Center of gravity 

l_jV(t)dt S' (0) 

r vm* 2mS(0) 

J ou 


First moment 

f« S'(0) 


Moment of inertia 

f» , S"(0) 

f J V(/)df=~3 

J -o« -4ir 


Moment of nth order 

f* S tn) (0) 


Equivalent width 

J-xV(O) J -» SCO) 1 


Inequalities 

|V(»)| * \ \\S(f)\df 



V’(t) ^ 2rr f" |/S(/)| df 

J “O© 
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presses the periods of all harmonic components equally and therefore raises the 
frequency of every component by the same factor. Since 1/(0) remains unaffected 
by time-scale changes, the area under the spectrum must, by the definite-integral 
theorem, remain constant, hence the compensating factor which appropri¬ 
ately weakens the spectrum if it spreads to higher frequencies. 

Addition theorem. Even when translated into the language of electrical wave¬ 
forms and spectra, this theorem is simply an expression of the linearity of the 
Fourier transformation. It has nothing to do with the linearity of the systems in 
which the waveforms are found; it must, of course, be true even of waveforms in 
nonlinear circuits. The linear property of the transformation makes it suitable, 
however, for dealing with linear problems. 

Shift theorem. When a waveform V(t) is delayed by a given time interval T, 
its harmonic components are affected in different ways; for example, a compo¬ 
nent whose frequency is equal to or is an integral multiple of T is not affected 
at all. Components whose period is much greater than T are not affected much, 
but those with periods short compared with T may be seriously altered in phase. 
In general, we can say that the component of period T, = /, ' will be unchanged 
in amplitude but delayed in phase by 2ttT/T x . Hence each component S(/,) be¬ 
comes exp (-i27r/ 1 T)S(/ 1 ). 

Modulation theorem. In the ordinary method of imposing an audio-frequency 
tone of angular frequency w on a carrier wave of angular frequency Cl, the mod¬ 
ulated waveform is 

(1 + M cos ojt) cos ilt, 

where M is the depth of modulation. This waveform differs from the unmodu¬ 
lated carrier cos f It by the addition of M cos ill cos cut, a quantity in the form to 
which the modulation theorem applies. 

The modulation theorem states that if a waveform V(t) has a transform S(/), 
then the waveform l/(f) cos cot is derivable by splitting S(/) into two halves, one 
of which is slipped to the right by an amount co/Itt, the other going an equal dis¬ 
tance to the left. Hence if 

V(t) = M. cos nt, 


for which S(f) = ^ MS^f + ^ — ^j, 

then the transform of M cos ilt cos cot is 
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and this latter expression must be added to the spectrum of the unmodulated car¬ 
rier cos ilt (addition theorem) to give the spectrum of the amplitude-modulated 
wave (1 + M cos cjI) cos ilt. In this way the familiar sidebands of simple mod¬ 
ulation theory are reproduced (see Fig. 9.3). 

Converse of modulation theorem. Two identical signals are sent out in suc¬ 
cession; the spectrum of the composite signal is obtained from the spectrum of 
one signal alone by multiplication by a cosine function of frequency. Thus 

V(t + I) + l/(f - T) D 2 cos 2 tt Tf S(/). 

In this expression of the converse theorem the time origin has been chosen 
midway between the origins of the separate signals, but one could also write (see 
Fig. 9.4) 

V(t) + V(f - 2T) D 2e i2 ” Tf cos 2nTf S(f). 

Both forms are derivable directly from the shift theorem. 





t 
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Fig. 93 Modulated waveforms and their spectra. 
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Fig. 9.4 The converse of the modulation theorem. 


LINEARITY AND TIME INVARIANCE 

Suppose that V 2 (f) is the response of a filter to a stimulus V,(f), and that W 2 (f) is 
the response to W,(f). Then the filter is said to be linear if the response to 
V,(f) + W^f) is V 2 {t) + W 2 (f), irrespective of the choice of V[(f) and W^f). Some¬ 
times a condition is added that aV t (t) shall have a response aV 2 (t) for all a and 
Vi(t), but one can deduce this relation from the superposition property (proving 
it first where a is an integer, then a ratio of integers 1 ). 

Time invariance means that the response to V,(f - T) is V 2 (t — T) for all T 
and Vi(f). 

As a consequence of linearity and time invariance a stimulus A cos 27r/f, 
where / is any frequency, produces a response 

B cos (27r/f - <f>), 

where <}> and B/A may vary with frequency. Thus the response is of the same form 
but possibly delayed in phase by an amount <£ and possibly different in ampli¬ 
tude by a factor B/A. The quantities <p and B/A are properties of the filter and 
may be compactly expressed in the form of a single complex quantity T(/), the 
transfer factor, defined by 

T(/) = !«■». 

The essential feature of the above assertion, which will be now proved, is that a 
stimulus of harmonic form at a given frequency produces a response that is of 
the same form and the same frequency, regardless of the choice of frequency. This 
property is sometimes loosely referred to as "harmonic response to harmonic in¬ 
put." 

Let the input stimulus be of unit strength and let it be the real part of a com¬ 
plex time-dependent function V,(f) defined by 

V,(f) = 


1 For a guide to the mathematical considerations that arise when the possibility of a voltage being ir¬ 
rational is not excluded ab initio, see Newcomb (1963). 




210 


The Fourier Transform and Its Applications 


Then the response can be shown to be given by 

V 2 (t) = T(f)e' 2nf> . 

The circumflex accent reminds us that, contrary to custom, we are using com¬ 
plex instantaneous values instead of real ones. This is done for algebraic sim¬ 
plicity. 

To prove the assertion, let the response to l/,(f) = exp (Hit ft) be 
K(f,t) exp [Hit ft), a quite general function of/and t, from which the exponential 
factor is extracted for convenience. Now apply a delayed stimulus 
exp [/27r/(f — T)J; because of time invariance the response will be K(f,t - T) exp 
[;27r/(f — T)]. However, the delayed stimulus can be expressed as the product of 
the original stimulus with a complex constant exp (-/27 t/T); that is, 

^n/V-T) = e -,2 ir/T^f). 

Hence the response can, because of linearity, be expressed as the product of the 
original response with this same complex factor. Thus 

K{f, t - Ty u f (, - J) = e-‘ 2 ”> r K{f,ty 2 ”f', 

and therefore K(f, t - T) = K(f,t); 

that is, K(f,t) is time-invariant and may be represented simply by T(/). 

The basic property of harmonic response to harmonic stimulus is thus shown 
to be a consequence of linearity plus time invariance. 

We now show that the existence of a convolution relation 

V 2 {t) = l(t) * V,(/) 

between the stimulus and response is an equivalent condition. 

Since the filter is linear, the response may be expressed in the form of the most 
general linear functional of the stimulus l/,(f); that is, let 

vjf)- j' i(ir)v,(r)dr. 

Given also time invariance, under which V,(f — T) produces V 2 (t — T) for all T, 
it follows that 


V 2 (t -T)= (' J(W)V } (t‘ -T)dr 

J -oo 

or V 2 {t) = j' l(t + T,t' + 7)1',(/')rf*'- 

Hence /(f, f) = ](t + T,t’ + T), for all T, 

is the condition for time invariance. It follows that is a function purely of 
t - t’. Thus 


nt,n = i(t - n 
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and V 2 (t) = f°° l{t - t')V t {t’)dt'. 

J -oo 

Hence linearity plus time invariance implies the convolution relation. 


PERIODICITY 

A nonconstant function/(.r) defined for all .r is said to be periodic, with period T, 
if there is a positive constant T such that f(x + T) = /( x), for all x. The function 
does not have to be continuous. A function can have more than one period, for 
example, cos x has a period 2tt, but is also periodic with period 47r, 6tt, .... The 
smallest period is the fundamental period. A system of impulses such as III(x) 
does not meet the requirement of being defined for all x, but a sequence of func¬ 
tions defining III(jc) may be produced, each one of which is periodic with unit pe¬ 
riod; one could say that lll(x) is periodic-in-the-limit (no one does). The sum of 
two periodic functions is not necessarily periodic (cos x + cos ttx) but may be 
(cos x + cos 99 .y), and may have more than one period. The presence of a peri¬ 
odic component does not guarantee periodicity and conversely a waveform may 
be periodic without any trace of a component at the corresponding frequency be¬ 
ing detectable in the Fourier analysis (see Problems). 
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PROBLEMS 

1. When a voltage tH(t) is applied to a circuit, the response R{t) is called the ramp 
response. Show that the response to a general applied voltage V'' ) (f) is given 
by 


j' R{t - u)V1(u)du 
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and that this expression is particularly suited to situations where the input voltage 
waveform is a polygon. 

2. A sound track on film is fed into a high-fidelity reproducing system at twice the correct 
speed. It is physically obvious, and the similarity theorem confirms that the frequency 
of a sinusoidal input will be doubled Ponder what the similarity theorem says about 
amplitude until this is also obvious physically. 

3. A transparent band (at x = 0) in an otherwise opaque sound track is scanned by a rec¬ 
tangular slit. Show that the equivalent width of the response is equal either to the width 
of the band or to the width of the slit. 


4. A signal of finite duration is applied to a filter whose impulse response is brief in du¬ 
ration compared with the signal. Show that the output waveform has a longer duration 
than the input waveform but that the amount of stretching, as measured by equivalent 
width, is short compared with the duration of the impulse response. 


5. The (complex) electrical length of a uniform transmission line is 0. Show that the trans¬ 
fer factor relating the output voltage to the input voltage is given by T(/) = sech 0 
when no load impedance is connected. 


6. A filter consists of a tee-section whose series impedances are Z, and Z 2 and the shunt 
impedance is Z v Show that the voltage transfer function is given by 


T(f) = 


Z 3 

Zi + Z 3 


7. In the tee-section of the previous problem, let Z 2 = 0 and Z 3 = R. The element Z, is an 
open-circuited length of loss-free transmission line of characteristic impedance R, so 
that we may write Z, = —iR cot 2 nT /, where T is a constant. Show that the output volt¬ 
age response to an input voltage step is a rectangle function of time, and hence that in 
general the output voltage is the finite difference of the input voltage. 

8. A very large number of identical passive two-port networks are cascaded, and a volt¬ 
age impulse is applied to the input, causing a disturbance to propagate down the chain. 
The disturbance at a distant point is expressible by repeated self-convolution of the im¬ 
pulse response of a single network. Does the disturbance approach Gaussian form? 

9. Show that a linear system can be imagined whose response to a modulated signal 
(1 + M cos mI) cos i'll is proportional to the audio signal M cos cot. 

10. Fourier coefficients. Let the y deflection of the spot on a cathode-ray oscilloscope be 
controlled by a periodic voltage waveform p(t) of unit period so that, in some units, 
y = p(t) and let the x deflection be controlled by a time-base generator running at a fre¬ 
quency n so that x = sin 27r;i/. Show that the area of the figure traced out in one period 
leads to a value of the Fourier coefficient a„ and that the corresponding value of b n can 
be obtained similarly. 

11. Time invariance. A two-port system contains nothing but a gate that is initially open 
but closes the first time a step in the input voltage occurs. Prior to this event, there is 
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no output, whatever the continuous input; but subsequently the output faithfully fol¬ 
lows the input. Smith says, "It is clear to me that the response to V,(f — T) is V 2 (t — T) 
no matter what value T has and no matter what the input waveform V t is. Therefore, 
the system is time-invariant." But Jones says, "I don't agree. I fed some music into that 
box this morning and nothing came out, but this afternoon I fed in the same waveform 
and it was transmitted perfectly." Is the system (a) time-invariant; (b) lmear?0 

12. Elastic capacitor. A parallel-plate capacitor contains solid dielectric that is squeezed 
when the capacitor is charged, the compression being proportional to the attractive 
force between the opposite charges. When a sinusoidal voltage is applied, the capaci¬ 
tance rises above its base value twice per cycle because the capacitance is increased 
when the plates are closer together. When the sinusoidal voltage is at 1000 hertz, the 
capacitance varies at 2000 hertz, and it is apparent that the current drawn will not be 
strictly sinusoidal. Consider the system whose input is the voltage and whose response 
is the current. Is the breakdown of sinusoidal response to sinusoidal input due to a fail¬ 
ure of linearity, time invariance, or both? t> 

13. Linearity and space invariance. A glass slide carries a two-dimensional image /(x,y), 
where the value of/is the light intensity emerging from the glass when light falls on it. 
A second slide g(*,y) (a mask) is placed in contact with it. The quantity g is the trans¬ 
mission factor (ranging from 0 to 1). The effect of the mask is to multiply the original 
image by g(x,y) to transmit a new image /i(jr,y) - /(x,y)^(jc,y). 

(a) Show that the operation of multiplication is linear but space variant. 

(b) Give an example of a particular mask to show how high spatial frequencies in the 
original image may be reduced to low spatial frequencies. 

14. Linearity. A certain device, which is suspected to be nonlinear, is subjected to the fol¬ 
lowing test. A pulse generator is available that can supply voltage pulses ranging in du¬ 
ration from 1 to 100 microseconds and with amplitudes from 1 millivolt to 1 volt, and 
also an oscilloscope to monitor the response current. It is observed that when the pulse 
duration dial is set, the waveform seen on the oscilloscope is proportional in amplitude 
to the voltage of the pulse. Regardless of the pulse duration selected, this proportion¬ 
ality is always observed. Does this establish that the device is linear? (We realize that 
higher voltages than those used in the test may produce nonlinear results such as 
sparks: therefore, we are only asking if the device is linear for amplitudes of excitation 
not greater than those in the tests.) 
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If you say the device is linear, state and prove the superposition rule that it obeys (mak¬ 
ing due provision for the allowable limits of excitation.) 

If you do not admit that the device is linear, give an example of a nonlinear device 
that would pass the pulse generator test. 

15. Output proportional to input. A system is such that W,(f) is the response to V,(f) and 
nW,(f) is the response to nV t (t), where n is integral, for all !/,(#). Must the system be lin¬ 
ear? Show that the system specification is equivalent to the definition on p. 209, or pro¬ 
duce a system that meets the specifications and show that it is nonlinear. 

16. Associativity failure. Two two-port networks with impulsive responses /,(/) and I 2 (f) 
are connected in tandem so that the impulse response of the composite network is 
1(f) = f,(f) * I 2 (t). [This can be ensured to high accuracy by making the input imped¬ 
ance of the second network high, or can be made exact by defining Ii(f) to be the im¬ 
pulse response at the output terminals of the first network, with the second network in 
place] 

Let I,(f) = H(f), I 2 (f) = 6(f) - 8(t - 1), and 1(f) = n(f - |). If the voltage VJt ) at 
the input is given by VJt) = e~', then the output voltage is given by 
V out = VJt) * 1(f) = ri(f — 2 ) * e ' = " du — (e - l)c In effect, we have said 

that 

vuo = ^,n(o * [i,(o] * ihm 

By the associative property of convolution, we expect to be able to say that 

V.U0 = lVJt) * /,(f)] * I 2 (t), 

where the quantity in brackets is the response at the junction between the two net¬ 
works. But V jn (f) * /,(/) = e 1 * II(t) = - u)du = f'_^e“du, which is not a 

convergent integral. Discuss this breakdown of associatively. 

17. Associativity. What can be said about the associativity of convolution in the following 
cases? 

H{.x) * 8'{x) * H(-x) 

H(x) * 8'(x) * sgn x 
e x * (6(.r) - 8(x - 1)] * H(x). 

18. Stability. In mechanics a system is said to be stable if a small perturbation produces 
forces tending to return the system to its original configuration Similar usage is found 
in electronics in connection with amplifiers and feedback circuits. However, a different 
idea is also in use according to which a linear system is said to be stable if j V 2 (f)| < kM 
for any |\?i(f)| < M. In other words, if the input V,(f) keeps below a maximum value 
M in absolute value, then, for a stable system, the output will also remain below some 
maximum kM for any choice of the input waveform. In another form of the definition, 
the system is said to be stable if the absolute integral of the impulse response, 

|/(f)| dt, has a finite value k. Are the following systems stable? [Let V\(f) be the ap¬ 
plied voltage and V 2 {t) be the current that flows.] 
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19. Stability. A short-circuited loss-free transmission line of length / on which the wave ve¬ 
locity is v has a current impulse response 

6 <'> + 25 ('“?) + 2 S ('"t 9 + .... 

Because J' x ,|/(f)|rff is not finite, it seems to be unstable On second thoughts, 
if a bounded input voltage I"l(/) is applied, the current response is Z„'[ 11(7) + 
2n(f — 2 l/v) + 2n(/ — 4 l/v) + ... ], which is a bounded output. Since bounded input 
seems to produce bounded output, it now seems to be stable. What is the truth? 

20. Linearity: continuity of transformation. A mathematical system model has the follow¬ 
ing relations between input functions V^f) and output functions V 2 (t); namely, V 2 (t) is 
the same as !/,(/) except that any discontinuities are removed. To be precise, if V^t) has 
a finite number N of discontinuities of size } u J 2 , ..., /„ at l = n,, a 2 , ..., n N , then 

v 2 (0 = v'.(f) - 2 /„//(/ - «j. 

n 1 

Find out whether this system is linear and time-invariant. 

21 Continuity of transformation. Let A4(v) be a nonzero, real-valued function such as 
exp[-(l - a -2 ) 1 ]FI(.v/2) that possesses (nonimpulsive) derivatives of all orders and 
is zero for all t outside the interval (—1,1). Consider the sequence p T (x) = 
7 'M[t ‘(.r - t)] generated as 7—*0. The area under p T (x) remains constant indepen¬ 
dent of r. Given any value of v, 

lim i> r (.v) = 0 for all v. 

The reason is that all the profiles p T (x) are identically zero for x 0; and for any posi¬ 
tive x there is a value r = x/2 such that p r (x) = 0 for all smaller values of r. 

Apply p T (x) as an input to a linear system which is represented by a transformation 
5 that maps the input function p r (x) into an output function q,(x). Represent this by 

<7r = 


Kt) = z 0 ’ 


Let the transformation 5 be continuous: 
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Because of linearity the LHS «S[0] = 0; therefore, the RHS 

S[p T ) = 0. 

But we would expect to elicit the impulse response on the RHS. Does this mean that or¬ 
dinary physical systems are not continuous? 

22. Impulse response. A linear time-invariant system having an impulse response /(/) is 
excited by an input voltage V^(t), where 

l/,(f,r) = [1 +t 2 (1 -2r)\x\]n(j^ 

and produces a response V 2 (t,T). 

(a) Is it true that lim V 2 (t, r) = /(f)? 

(b) Does lim V\(f,T) exist? 

23. Sine function properties. Verify that 

m - cos (f) cos (f) cos (f) cos (^) 

is a good approximation to sine x by finding out how large x has to be before the error 
reaches 1 percent of the peak value. If the expression quoted is a good approximation 
to sine x, should not its Fourier transform be a good approximation to FI(s)? Discuss 
this question by first working out the transform. Now show that 

OO 

sine x = H cos 

n - l 

If the continued product is taken to N factors only, instead of to infinity, show that the 
formula can be saved by including a rather broad correction factor sine (.t/2 N ): 

sine * = II cos (|£)sincQQ. 

24. Rectangular impulse response. A signal entering a certain system with input at A and 
output at B is divided into two channels, one of which contains a delay T, and the other 
a longer delay T 2 , and then the two channels are brought together and added to form 
the output signal. Let the transfer function be T(/). 
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(a) Show that T, and T 2 may be chosen to make |T(/)| any desired cosine function of 
frequency. 

(b) Show that a chain of three such systems is suitable for practical equipment that is 
to generate a rectangular impulse response. Explain how to choose T-, and T 4 . 


25. Prolate spheroidal wavefunctions. Radial-meridional (nonlongitudinal) oscillations of 
electric field u around a conducting football obey the differential equation 


0 ~ f2 ) ^7 ~ 21 ^7 + (* ~ w2f2 )" = 


where t (later to be reinterpreted as time) is the meridional coordinate. The parameter 
w is (27r/free-space wavelength) X semi-interfocal distance, and the constant ^ is a sep¬ 
aration constant. For each choice of x and there is a series of resonant modes 
n — 0,1,2, . The corresponding electric charge solutions of the differential equa¬ 

tion, which are known as prolate spheroidal wavefunctions S 0 „(ce,f), turn out to be of 
interest where a signal must be squeezed into the shortest time and simultaneously into 
the narrowest band. A property of the prolate spheroidal wavefunctions is that 


J‘ 


sinc [ 2 (s) (,_ 


O S 0 „(<a,ca')df' 




where A is an eigenvalue. The subscript 0 refers to the absence of longitude depen¬ 
dence. Interpreting t as time, we may say that the integral operation consists of gating 
or truncating the operand to eliminate portions outside t = ±1 s, followed by sine 
function smoothing that eliminates frequencies a>/2v beyond ±1 Hz. The consequence 
of this squeezing operation is to leave unchanged except for a factor A. The pro¬ 

late spheroidal wavefunctions are thus eigenfunctions of the integral operator. The 
eigenvalue A, which may be looked up in tables (Abramovitz and Stegun, p. 753), is 

A = [R 0 „ ( Vl)] 2 - 

Show that the prolate spheroidal wavefunctions are also eigenfunctions of the fi¬ 
nite Fourier transform, that is, that 



S 0 „((o,t')dt' 


MS 0 „(w,f). 


26. Multiplication by x. Show that xf(x) D (i/2ir)F'(s).[> 

27. Elusive period, (fl) Make a plot of y(x) = 9 cos 5x + 11 cos 4x for 0 x ^ 6, but sup¬ 
pose that x actually runs from — oo to oo. Examine your sample of the function y(x) and 
decide whether y(.r) meets the condition for a periodic function. If yes, what is the pe¬ 
riod? If no, explain, (b) Plot the Fourier transform of y(x).0 

28. Periodic barcode. A pattern consisting of a set of thin black lines on white is made by 
printing 31 lines spaced by 5 mm of white and then overprinting with 37 lines spaced 
4 mm. The first black line of the second set falls exactly on the first black line of the first 
set. The lines have a width xv = 1 mm; thus each line is describable by II (x/w) suitably 
shifted. The final printing is describable by y(x), where y(x) = 0 for white and 1 for 
black. The printed barcode appears periodic to the eye, but is the corresponding fre¬ 
quency present in the Fourier transform Y(s)?t> 
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29. Spectral resolution. A spectrograph responds to a spectral line 8(.v) as exp(- rrx^/W 2 ). 
If there arc two equal spectral lines spaced X apart, the instrumental response is 
exp[-7r(x + ^L) Z /1V 2 ] + exp[-7r(.r — 2 L) 2 /W 2 ]. If the lines are well spaced, L » W, 
then two separate peaks are recorded with a minimum between. (<?) As the two lines are 
brought closer together there is a value L = L cr „, where the central minimum rises to 
the level of the two peaks. What is the value of L iri( ? (b) If the lines are more closely 
spaced, say L = 0.8L frl( , only one peak will be recorded. Would it then be possible to de¬ 
duce that two lines had been involved and to determine their line spacing? C> 

30. Filtering a digital signal. A discrete-time signal {1 1.6 2 0.6} whose elements are 
spaced one microsecond is applied to a resistance-capacitance filter whose impulse re¬ 
sponse is exp(-f/KC)H(f), where R = 1 ohm and C = 1 microfarad and the time con¬ 
stant RC is 1 microsecond. Represent the signal by the continuous-time impulse train 
V'i(f) = 8(f — 1) + 1.68(1 - 2) + 26(f - 3) + 0.68(1 - 4) and graph the response V 2 (t) 
as the sum of four exponentials, (a) Mark the values of V 2 (t) for t = 0, 1,2,3, 4, 5, 6 and 
give algebraic expressions for these values. ( b ) Comparp the coefficients in these ex¬ 
pressions with those obtained from numerical evaluation of the convolution 

{0.5 e ' c~ 2 c 3 e A ...} * {1 1.6 2 0.6}. O 
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Sampling and Series 


Suppose that we are presented with a function whose values were chosen arbi- 
trarily, and suppose that no connection exists between the neighboring values cho¬ 
sen for the dependent variable. Thus if the independent variable were time, we 
would have to expect jumps of arbitrary magnitude and sign from one instant to 
the next. 

In nature such a function would never be observed. Because of limitations of 
the measuring instrument, or for other reasons, there is always a limit to the rate 
of change. One might thus surmise that there is at least a little interdependence 
between waveform values at neighboring instants, and consequently that it might 
be possible to predict from past values over a certain brief time interval. This sug¬ 
gests that it might be possible to dispense with the values of a function for inter¬ 
vals of the same order and yet preserve essentially all the information by noting 
a set of values spaced at fine, but not infinitesimal, intervals. From this set of sam¬ 
ples it would seem reasonable that the intervening values could be recovered if 
only to some degree of approximation. 


SAMPLING THEOREM 

The sampling theorem states that, under a certain condition, it is in fact possible 
to recover with full accuracy the values intervening between regularly spaced 
samples; in other words, the sample set can be fully equivalent to the complete 
set of function values. The condition is that the function should be "bandlimited"; 
that is, it should have a Fourier transform that is nonzero over a finite range of 
the transform variable and zero elsewhere. Digital signal processing can be ap¬ 
plied to the sample set while at the same time the theory of functions of a con¬ 
tinuous variable can be advantageously applied to derive and clarify the basics 
of DSP. 
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Clearly, the interval between samples is crucial in deciding the utility of the 
theorem; if the samples had to be very close together, not much would be gained. 
As an illustration of the fineness of sampling we take a simple band-limited func¬ 
tion, namely sine x, whose spectrum is flat where |s| < ^ and zero beyond. The 
sampling interval, deduced as explained below, is 1. Figure 10. lz? shows the sam¬ 
ple values that define sine x, and it will be seen that the interval is extremely 
coarse in comparison, for example, with the interval that would intuitively be cho¬ 
sen for numerical integration. The sampling intervals indicated by this theorem 
often seem, at first, to be surprisingly wide. Also shown in Fig. 10.1b are a set of 
samples for sine 2 \x, a function whose spectrum cuts off at the same points (|s| = \) 
as that of sine x. Figure 10.1c and lO.ld provide some samples for experiment. 

With any given waveform, there is always a frequency beyond which spec¬ 
tral contributions are negligible for some purposes. However, on the other hand, 
the transform probably never cuts off absolutely; consequently, in applications of 
the sampling theorem, the error incurred by taking a given waveform to be band- 
limited must always be estimated. 



Fig. 10.1 Two functions and their samples, and two sets of samples for practice. 
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(c) 


x 



(d) 


Fig. 10.2 (a) A band-limited function fix) with a cutoff spectrum (b). The samples 

(c) suffice to reconstitute fix ) accurately in full detail and are equivalent 
in content to the train of impulses (d). 


Consider a function fix), whose Fourier transform F(s) is zero where |s| > s c 
(see Fig. 10.2). Evidently fix) is a band-limited function; in this case the band to 
which the Fourier components are limited is centered on the origin of s. Such a 
function is representative of a wide class of physical distributions which have 
been observed with equipment of limited resolving power. We shall refer to such 
transforms as "cutoff transforms" and describe them as being cut off beyond the 
"cutoff frequency" s t .. 

In general a cutoff transform is of the form n(s/2s,.)G(s), where G(s) is arbi¬ 
trary, and therefore the general form of functions whose transforms are cut off is 

sine 2s t ar * g(x), 

where £(x) is arbitrary. 

Of course, if the original function is cut off, then it is not a band-limited func¬ 
tion; it is the transform which is band-limited 

With the exception noted below, band-limited functions have the peculiar 
property that they are fully specified by values spaced at equal intervals not ex¬ 
ceeding jSf 1 (see Fig. 10.2c). 

In the derivation that follows, the introduction of the shah symbol proves con¬ 
venient, because multiplication by III(x) is equivalent to sampling, in the sense 
that information is retained at the sampling points and abandoned in between. 
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As an additional bonus, the shah symbol, as a result of its replicating prop¬ 
erty under convolution, enables us to express compactly the kind of repetitive 
spectrum that arises in sampling theory. 

In the course of the argument we use the relation 

III(x) D III(s), 

which is discussed at greater length at the end of this chapter. 

Consider the function 

t-'/WihQ = 2/(" t ) 5 (* “ UT ) 

shown in Fig. 10.2c. Information about f(x) is conserved only at the sampling 
points where x is an integral multiple of the sampling interval r. The intermedi- 





(e) 




S,. 


Fig. 10.3 Demonstrating the sampling theorem. 
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Fig. 10.4 Critical sampling. 


ate values of /(x) are lost. Therefore, if /(x) can be reconstructed from /(x)III(x/r), 
the theorem is proved. The transform of IIl(x/r) is rlll(rs). Fig. 10.3b, which is a 
row of unit impulses at spacing t" '. Therefore 

/(x)11I(x/t) = tIII(ts) * F(s), 

and we see that multiplication of the original function by III(x/r) has the effect of 
replicating the spectrum F(s) at intervals t 1 (see Fig. 10.3c). We can reconstruct 
f(x) if we can recover F(s), and this can evidently be done, in the case illustrated 
in Fig. 10.3c, by multiplying rlll(rs) * F(s) by FI(s/2s,). Except for cases of singu¬ 
lar behavior at s = s t (to be considered below), this is sufficient to demonstrate 
the sampling theorem. 

At the same time a condition for sufficiently close sampling becomes appar¬ 
ent, for recovery will be impossible if the replicated islands overlap as shown in 
Fig. 10.3c, and this will happen if the spacing of the islands t 1 becomes less than 
the width of an island 2s c . Hence the sampling interval r must not exceed ^s f ', 
the semiperiod of a sinusoid of frequency s,, and for critical sampling we shall 
have the islands just touching, as in Fig. 10.3d. 

A small refinement must now be considered before the sampling theorem can 
be enunciated with strictness. In the illustration F(s,) is shown equal to zero. If 
F(s c ) is not zero, the islands have cliffs which, under conditions of sampling at 
precisely the critical interval, make butt contact. In Fig. 10.4a this is on the point 
of happening, but careful examination, taking into account also the imaginary part 
of F(s), reveals that multiplication by ri(s/2s ( .) permits exact recovery of F(s). How¬ 
ever, if F(s) behaves impulsively at s = s f , that is, if/(x) contains a harmonic com¬ 
ponent of frequency s c , then there is more to be said. 

In Fig. 10.4b, which shows such a case, consider first that F(s) is even; that is, 
ignore the odd imaginary part shown dotted. Then as the sampling interval ap- 
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proaches the critical value, the impulses A and A' tend to fuse at s = s c into a sin¬ 
gle impulse of double strength, and multiplication by fl(s/2s f ) taken equal to | at 
s = s r , restores the impulse to its proper value, thus permitting exact recovery of 
F(s). The impulses A represent, of course, an even, or cosinusoidal, harmonic com¬ 
ponent: 2 A cos IttScX. Now consider the impulses contained in the odd part of 
F(s). Under critical sampling, B and B' fuse and cancel. Any odd harmonic com¬ 
ponent proportional to sin 2 ns,x therefore disappears in the sampling process. 

Exercise. The harmonic function cos (cot - </>) is sampled at its critical inter¬ 
val (the semiperiod tt/w). Split the function into its even and odd parts and note 
that the sample values are precisely those of the even part alone. Note that the 
odd part is sampled at its zeros. 

The sampling theorem can now be enunciated for reference: 

A function whose Fourier transform is zero for |s| > s,. is fully specified by values 
spaced at equal intervals not exceeding ^s c _1 save for any harmonic term with zeros at 
the sampling points. 

In this statement of the sampling theorem there is no indication of how the 
function is to be reconstituted from its samples, but from the argument given in 
support of the theorem it is clear that it is possible to reconstruct the function 
from the train of impulses equivalent to the set of samples, using some process 
of filtration. This procedure, which is envisaged as filtering in the transform do¬ 
main, evidently amounts in the function domain to interpolation. 


INTERPOLATION 

The numerical process of calculating intermediate points from samples does not 
of course depend on calculating Fourier transforms. Since the process of recov¬ 
ery was to multiply a transform by n(s/2s,), the equivalent operation in the func¬ 
tion domain, namely, convolution with 2s r sine 2 s.x, will yield f(x) directly from 
III(x/t)/(.v). Convolution with a function consisting of a row of impulses is an at¬ 
tractive operation numerically because the convolution integral reduces exactly 
to a summation (serial product). 

For midpoint interpolation we can permanently record a table (see Table 10.1) 
of suitably spaced values of sine x, and it proves practical when further interpo¬ 
lation is required to repeat the midpoint process, using the same array. 


RECTANGULAR FILTERING IN FREQUENCY DOMAIN 

Suppose that it is required to remove from a function spectral components whose 
frequencies exceed a certain limit, that is, to multiply the transform by a rectan- 
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■ TABLE 10.1 

Midpoint interpolation 


1*1 

sine x 

1*1 

sine x 

1*1 

sine x 

1*1 

sine x 

1 

2 

0.6366 

4 

-0.0335 

18* 

0.0172 

27* 

-0.0116 

li 

-0.2122 

10J 

0.0303 

19* 

-0.0163 

28* 

0.0112 

2* 

0.1273 

ni 

-00277 

20* 

0.0155 

29* 

-0.0108 

3* 

-0.0909 

124 

0.0255 

21* 

-0.0148 

30* 

0.0104 

4 

0.0707 

13’ 

0.0236 

22* 

0.0141 

31* 

-0.0101 

5* 

-0.0579 

Mi 

0.0220 

23* 

-0.0135 

32* 

0.0098 

4 

00490 

154 

-0.0205 

24* 

0.0130 

33* 

-0.0095 

7* 

-0.0424 

16j 

0.0193 

25* 

-0.0125 

34* 

0.0092 

4 

0.0374 

17* 

-0.0182 

26* 

0.0120 

35* 

-0.0090 


gle function, which we shall take to be n(s). We are assuming that s c = ^ and that 
the critical sampling interval is 1. This is just the operation which has already 
been carried out for the purpose of interpolation. However, in general the func¬ 
tion to be filtered will not consist solely of impulses, and the convolution integral 
giving one filtered value does not reduce exactly to a summation. However, when 
it is evaluated numerically it will have to be approximated by a summation. 


2, = /(*) * 



sine* 


and we may ask how coarse the tabulation interval may be and still sufficiently 
approximate the desired integral 

f(x) * sine x. 

Beginning with t = 1, we find Si = /(*); that is, no filtering at all has resulted. 
Now trying t = we have 


Zj = f(x) * III(2t) sine x 
and Sj = F(s)[|lll(is) * n(s)], 

since Z T = F(s)[rIII(rs) * n(s)]. 

Hence Xj consists of a central part F(s)n(s) plus remoter parts. For many pur¬ 
poses this simple operation would suffice (for example, when the components to 
be rejected lie chiefly just beyond the central region). 

Adopting an idea from the method of interpolation, where we economize on 
interpolating arrays by repeated use of the one midpoint interpolation array, we 
now consider the effect of repeated approximate filtering of the one kind. By us¬ 
ing the same filtering array at t = | we have the filter characteristic 
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Fig. 10.5 Numerical procedure for achieving the desired filter characteristic I"I(s). 


jIII(s/4) * n(s/2), which when multiplied by 2lII(s/2) * n(s) gives the bottom line 
of Fig. 10.5. In other words, repeated application of the process has pushed down 
more of the outer islands of response. The same result is obtained by taking r = | 
initially. 

To summarize, approximate rectangular filtering with a cutoff at s, is carried 
out by reading off f(x) at half the critical sampling interval (that is, at intervals of 
K 1 ) and taking the convolution (more precisely, the serial product) with 2s ( sine 
2 s,*, where 2assumes all half-integral values, including 0. This filtering array 
for use in the function domain (see Table 10.2) contains precisely the values tab¬ 
ulated for interpolation plus interleaved zeros and a central value of unity. 


SMOOTHING BY RUNNING MEANS 

Convolving a function f(x) with a rectangle function of width W results in the 
transform F(s) being subjected to a form of low-pass filtering that is far from hav¬ 
ing the sharp cutoff discussed above. We understand that the transfer function 
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■ TABLE 10.2 

Array for approximate rectangular filtering 


-0.0909 

0 

0.1273 

0 

- 0.2122 

0 

0.6366 
> 1.0000 
0.6366 
0 

-0 2122 
0 

0.1273 

0 

-0.0909 


associated with convolution with Wfl(x/W), given by F(s) = sine VVs, has a pass 
band of equivalent width 1/W, or a 3 dB bandwidth of 0.8859/W, but that the fall- 
off in transmission is not at all sharp enough for many purposes. Moreover, the 
transmission does not descend gracefully to zero but overshoots and oscillates 
rather strongly. How to make a trade-off between sharpness of cutoff and mild¬ 
ness of the sidelobes, to borrow a convenient term from antenna practice, will 
now be discussed, starting with the rectangular convolving function as a basis for 
comparison. However, we look at the convolving operation as a numerical one to 
be applied to discrete data, in the spirit of Chapter 3 and tine exercises there. 

Suppose that W = 12, a case that can be thought of as generating 12-month 
running means from 12 data samples one month apart. Instead of n(x/W) we deal 
with Y 2 2S(-V — n), for n — ± 5 , ±1^, ••• ±5^. The associated transfer function will 
be like sine 12s for small s, but will be replicated at unit intervals in the 
s-domain, as follows from the transform of |^III(jc - ^)n(x/12), namely 
[c ^IIl(s)] * sine 12s. The overlapping sine functions can be simplified by trans¬ 
forming the impulses 2£(x - n) pair by pair to get 2 2 cos 2-nns, 
n = 1^, 2\, ... 5^. To condense further, transform impulse by impulse to get the 

geometric series 


1 

12 


+ ^i2ir4ts 


+ ... + e~ ,2 " 45s + e - ,2n *), 
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where the ratio r of each term to the preceding one is e -i2ws and the first term is 
a = (^)exp(/27r5^s). The expression «(1 — r")/(l — r) for the sum of a geometric 
series of u terms then gives 


- r ,2 )/( 1 - r) = ^ > e' 2n55s (l - *-«•»*)/(! - e" 2,ri ) 


12 


— (e' 27rf>s — e , 2 r * , ')/(c~' 2 '^ i: ' — e ,2l ^ s ) 


1 sin 2ti6s 


12 


sin 


27J?S 


In general, for N equispaced impulses of strength 1 /N this expression becomes 
(sin Nns)/(N sin tts), which is convenient for computing and is shown in Fig. 
10 . 6 . 

It has been standard practice in meteorology to calculate annual running 
means using 13 coefficients one month apart instead of 12 but to reduce the first 
and last to half strength, keeping the sum of the strengths at 12; the transition to 
zero is smoother. In this case the transfer function becomes sin Nns/(N tan 7rs). 

The upper curve of Fig. 10.6 is recognizable as the antenna field pattern of an 
array of 12 well-spaced small antennas, while the square of the same curve is the 
optical diffraction pattern of a row of 12 pinholes. 




Fig. 10.6 The transfer function for 12 coefficients of strength ^ (top curve). With 
13 coefficients, those at the ends being of half strength, the sidelobes are 
somewhat reduced (bottom) and the first order "grating lobes" are not 
reversed in phase. 
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UNDERSAMPLING 

Suppose that f(x) (see Fig. 10.7 a) is read off at intervals corresponding to a de¬ 
sired cutoff for rectangular filtering. Then this set of values (see Fig. 10.7b) defines 
a band-limited function #(*) (see Fig. 10.7c) that has a cutoff spectrum of the de¬ 
sired extent and may at first sight appear to be a product of rectangular filtering. 
But the process is not the same as rectangular filtering, since the result depends 
on high-frequency components in f(x); for example, one of the sample values may 
fall at the peak of a narrow spike; furthermore, the phase of the coarse sampling 
points will clearly affect the result. However, the effect may often be a good ap¬ 
proximation to rectangular filtering. 

By examining the process in terms of Fourier transforms, we see that the band- 
limited function g(x) derived from too-coarse sampling contains contributions 
from high-frequency components of f(x), impersonating low frequencies in a way 



Fig. 10.7 A band-limited function g(x) derived from /(:r) by undersampling; high- 
frequency components of fix) shift inside the band limits. Shaded areas 
indicate high frequencies masquerading as low. 
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that looks like reflection of the high-frequency part in the line s = s c . The effect 
has been referred to as "aliasing." Closer scrutiny of Fig. 10.7(b), taking into ac¬ 
count the omitted imaginary part of the transform, will reveal that the spurious 
low positive frequencies derive from the shaded negative-frequency tail of F(s). If 
this high-frequency tail is not too important, then the coarse sampling procedure 
gives a fair result. 

While the effect of undersampling is to reinforce the even part of the spectrum. 
Fig. 10.7d shows that the odd part is diminished. It follows that#(jc) will be evener 
than f{x), which is, of course, to be expected, for the sampling procedure discrim¬ 
inates against the (necessarily odd) components with zeros at the sampling points. 


ORDINATE AND SLOPE SAMPLING 

Let f(x) be a band-limited function that is fully specified by ordinates at a spac¬ 
ing of 0.5; but suppose that only III/is given; that is, only every second ordinate 
is given. Then from the overlapping islands (see Fig. 10.8) composing III/, it would 
not be possible to recover F(s) or, consequently, f(x). But if further partial infor¬ 
mation were given, it might become possible. 

If the slope is given, in addition to the ordinate, recovery proves to be possi¬ 
ble. Thus, given Ill/and III/', one can express/(x) as a combination of linear func- 






Fig. 10.8 Ordinate sampling at half the rate necessary for full definition. 
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tionals of III/and III/': 

f(x) = a(x) * (III/) + b(x) * (III/'), 

where rt(x) and b(x) are solving functions that have to be found. Just as the sine 
function, which is the solving function for ordinary sampling, must be zero at all 
its sample points save the origin, where it must be unity, so must a(x). And fc(x) 
must be zero at all sample points but have unit slope at the origin. 

To find a(x) and b(x), note that in the interval —1 *£ s 1 

Uif = F(s + l) + F(s ) + F(s - 1 ) 

and that III J' = /2tt(s + l)F(s + 1) + i2ttsF(s) + i2it(s - 1 )F(s - 1). 

These two equations can be solved for F(s), for although there appear to be three 
unknowns, namely, F(s + 1), F(s), F(s — 1), in fact, for any value of s, one of them 
is always known to be zero. Thus for positive s we have F(s + 1) = 0, and on 
eliminating F(s — 1) we have 

i2ttF(s) = m/ 7 - /2 tt(s - 1)IU7, 

and for negative s we have 

-;2ttF(s) = Ulf 7 - i2n(s + 1)HI/. 

For all s, both positive and negative, we have concisely 

F(s) = ^A'(s)ill/ 7 + A(s)m7. 

Hence f(x) = sine 2 .t * (III/) + .t sine 2 x * (III/'). 

The solving functions are 

a(x) — sine 2 x 
b(x) = x sine 2 x, 

and the convolution integrals reduce to a sum of spaced a's and b’s of suitable 
amplitudes. 


/(*) = X/("M* ~ ») + 2 f{n)b{x - n) 

■"•X.* oo 

= 2/(") sinc2 ( Y ~ «) + 2 /'(”)( y - ») sine 2 {x - n). 

—oc — <x* 


We see that each a(x — >/) is zero at all sampling points (integral values of x) save 
where x = n, and that each has zero slope at all sampling points (see Fig. 10.9rt). 
Each b(x — n) has zero ordinate at all sampling points and likewise zero slope, 
save where x = n (see Fig 10.9b). 
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(a) 


x 



Fig. 10.9 (a) The ordinate-dependent constituents f(n)a(x - n ); (b) The slope- 

dependent constituents f'Mblx — tt). 


INTERLACED SAMPLING 

As in the previous example, let III/represent every second ordinate of the set that 
is necessary to specify/(.x), and let a supplementary set III(x — «)/(*), interlaced 
with the first as illustrated in Fig. 10.10, also be available. Will it be possible to 
reconstitute/(x)? It is known that equispaced samples, separated by just more 
than the critical interval, do not suffice, and in the case of interlaced sampling 
every second jump exceeds this critical interval. On the other hand, it has been 
shown that ordinate-and-slope sampling suffices, and this is clearly equivalent to 
extreme interlacing as a approaches zero. 

If there is a solution, it should be in the form of a sum of two linear func¬ 
tionals of III/and III a f, where III a = III(jc - a): 

f(x) = a(x) * (III/) + b(x) * (III*/). 

The solving function a(x) must be equal to unity at x = 0, and zero at all other 
sampling points, and b(x) must be the mirror image of a(x)- that is, b(x ) = *?(—x). 
In the interval -1 < s < 1, 

HI/ = F(s + 1) + F(s) + F(s - 1) 

and = e‘ 2na F(s + 1) + F(s) + e- ,2na F(s - 1). 

For positive s we have F(s + 1) = 0, and on eliminating F(s — 1) we have 
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Fig. 10.10 Interlaced samples. 


and for negative s we have 

, 2 na - j _ 

Hs) = ~T^r. u 'f + 

For all s we have 


F(s) = A(s)Ulf + A*{s)\\\J, 


where 


Hence 


m 



0 < s < 1 

-1 < s < 0 
|s| > 1 



\i cot <77rA'(s). 


rt(x) = sine 2 x - (7r cot air)x sine 2 x. 


as graphed in Fig. 10.10. 1 

It may seem strange that the equidistant samples may be regrouped in pairs, 
even to the extreme of close spacing. However, it is also possible to bunch the 
samples in groups of any size separated by such wide intervals as maintain the 
original average spacing. The bunching may be indefinitely close; see Linden for 
a proof that the ordinates and first n derivatives, at points spaced by n + 1 times 


1 For a discussion of sampling theorems see Linden, (1959). In this paper the solving function n(v) is 
given in the form 

cos (2irx - an) — cos an 

a(x) =---:-. 

2nx sin an 

The numerator is a cosine wave so displaced that it has zeros at x = n and x = n + a, but the zero at 
x = 0 is counteracted by the vanishing of the denominator in such a way that <i(0) = 1. 
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the usual spacing, suffice to specify a band-limited function. In the limit, as n ap¬ 
proaches infinity, the formula for reconstituting the function becomes the Maclau- 
rin series. This introduces doubt of the practical applicability of higher-order sam¬ 
pling theorems, for it is well known that the Maclaurin series 

m + */■( o) + |/" ( o) +... + £/ ( "’(o) 

does not usually converge to fix). (Consider the functions n(rtx), which, for dif¬ 
ferent values of a, all have the same Maclaurin series ) 

In practice, higher-order sampling breaks down at some point because small 
amounts of noise drastically affect the determination of high-order derivatives or 
finite differences. In the total absence of noise, trouble would still be expected to 
set in at some stage because of the impossibility of ensuring perfectly band- 
limited behavior. In applications of sampling theorems, the claim of a given func¬ 
tion to be band-limited must always be scrutinized, and any error resulting must 
be estimated. 


SAMPLING IN THE PRESENCE OF NOISE 

Suppose that the samples fin) of a certain function fix) cannot be obtained with¬ 
out some error being made; that is, the observable quantity is 

/(/») + error. 

Then when an attempt is made to reconstruct fix) from the observed samples by 
applying the same procedure used for true samples, the reconstructed values will 
differ from the true values of fix). 

Consider the case of midpoint interpolation, supposing that samples have 
been taken at .r = ±\, ±l|, ±2\, ... . Then 

/(0) = 0.6366[/(i) + /(-*)] - 0.2122[/(ll) + /(-l*)] 

+ 0.1273[/(2|) + /(-2*)] - .... 

The errors affecting f{\) and f(-{) will have the greatest effect on /(0); each error 
is reduced by 0.6366, and the resulting net error at x = 0, due to the errors at the 
nearest two sampling points, could be anywhere from zero, if the two errors hap¬ 
pened to cancel, up to 1.27 times either error. Clearly, the error involved in using 
the sampling theorem to interpolate will be of the same order of magnitude as 
the errors affecting the data. More than this could not be expected, and so it may 
be concluded that the interpolating procedure is tolerant to the presence of noise. 

It is not the purpose here to go into statistical matters, but a simple result 
should be pointed out that arises when the errors are of such a nature that they 
are independent from one sample to the next, and all come from a population 
with zero mean value and a certain variance it 2 . Then the variance of the error 
contributed at x = 0 by the error at v = \ is (0.6366) 2 o- 2 , and the variance of the 
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total error at x = 0 due to the errors at all the sampling points is 

[... + (0.I273) 2 + (0.2I22) 2 + (0.6366) 2 + (0.6366) 2 + (0.2122) 2 

+ (0.1273) 2 + ...]er 2 . 

Now the terms of the series within the brackets are values of sine 2 x at unit in¬ 
tervals of x and hence add up to unity. Therefore, in this simple error situation, 
the interpolated value is subject to precisely the same error as the data. 

Now we apply the same reasoning to interlaced sampling, especially to the 
extreme situation where the narrow interval is small compared with the wide one, 
that is, where a «. 1. At the point x = \a + which is in the middle of the wide 
interval, the four nearest sample values enter with coefficients 

a(\a + \) f b(-\a + \), a{\a - \),b(-\a - ^). 

The first and last of these are positive and the others negative, and the presence 
of the factor cot <?7r in the formula for a(x) shows that the numerical values may 
be large. Thus the interpolated value may result from the cancellation of large 
terms, and the total error may be large. 

In another way of looking at this, a pair of terms 

/(0)4r) + f{a)b(x - a) 

may be reexpressed in the form 


[«(*) + l, (x - <*)] 


m + m 


b(x — a) - u(x) 

+ -— i —-[/(«)- mi 


Here the first term represents the mean of a sample pair multiplied by a certain 
coefficient, and the second represents the difference between two close-spaced 
samples multiplied by a certain other coefficient. In the limit as a — >0, the solv¬ 
ing functions for the ordinate-and-slope sampling theorem would result. Now the 
coefficient of the difference term can be large; for example, when a < 0.2, the 
value adopted in the illustration of interlaced sampling, the coefficient exceeds 
unity. Thus errors in the difference terms may be amplified. 

It thus appears that interlaced sampling, where the sample spacing is alter¬ 
nately narrow and wide, is not tolerant to errors, and therefore the magnitude of 
the errors would have to be estimated carefully in an application. In a full study 
it would be essential to take account of any correlation between the errors in suc¬ 
cessive samples since it is clear that the error in f{a) - f( 0) would be reduced if 
both f(n) and /(0) were subject to about the same error. 


■ 

FOURIER SERIES 


It is well known that a periodic waveform, such as the acoustical waveform as¬ 
sociated with a sustained note of a musical instrument, is composed of a funda¬ 
mental and harmonics. Exploration of such an acoustical field by means of tun- 
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able resonators reveals that the energy is concentrated at frequencies which are 
integral multiples of the fundamental frequency. There is nothing here that should 
exclude this case from treatment by the Fourier transform methods so far used. 
However, insistence on strict periodicity, a physically impossible thing, will clearly 
lead to an impulsive spectrum and to the refined considerations that are needed 
in connection with impulses. We now proceed to do this, using the shah symbol 
for convenient handling of the sets of impulses that arise, in connection both with 
the replication inherent in periodicity and with the sampling associated with har¬ 
monic spectra. 

The Fourier series will be exhibited as an extreme situation of the Fourier 
transform, even though the opposite procedure, taking the Fourier series as a point 
of departure for developing the Fourier transform, is traditional. 

For reference let it be stated that the Fourier series associated with the peri¬ 
odic function g(x), with frequency / and period T, is 

ro 

a 0 + 2 i a " cos 27rn fx + b„ sin 2imfx), 

i 

1 fir 

where a ti = -J #(*)</* 

2 fir 

a " = fJ-lrS( X > cos 2-Trnfx dx 

2 fir 

K = jJ 1 t 2( y ) sin 2 irnfxdx. 

It is necessary for #(.*) to have been chosen so that the integrals exist; otherwise 
gCx) is arbitrary. 

The purpose of a good deal of theory dealing with the Fourier series has been 
to show that the series associated with a periodic function #(x) does in fact often 
converge, and furthermore, that when it converges, it often converges to 

&TU + 0) + s(* - 0)]. 

The rigorous development of this topic was initiated by Dirichlet in 1829, fol¬ 
lowing a controversial period dating back to D. Bernoulli's success in 1753 in ex¬ 
pressing the form of a vibrating string as a series 

y — A ] sin x cos at + A 2 sin2.r cos 2at + _ 

Euler, who had been working on this problem and had just obtained the general 
solution in terms of traveling waves, said that if Bernoulli was right, an arbitrary 
function could be expanded as a sine series. This, he said, was impossible. In 1807, 
when Fourier made this same claim in his paper presented to the Paris Academy, 
Lagrange rose and said it was impossible. This exciting subject led to many im¬ 
portant developments in pure mathematics, including the invention of the Rie- 
mann integral. It must be remembered that the expressions for the Fourier con¬ 
stants a,„ b„ were given long before modern analysis developed. 
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For the present purpose let us take T = 1 and note that the complex constant 
a„ — ib„ is related to the one-period segment g(x)n(x) by the Fourier transform 

a„ - ib„ = 2 J \g(x)e i2nnx dx 

= 2 f* ^x)n(.r)c- ,2 ™ r tfa- = 2 F(u). 

J — cx 

We now recover this result by considering the Fourier transform of a periodic 
function. 

Let f(x) be a function that possesses a regular Fourier transform F(s) (see Fig. 
10.11). Then its convolution with the replicating symbol IllCt) will be the periodic 
function p(x), defined by 

0tl 

p(x) = III(.t) * f(x) = ^ f(x - n) ti integral. 

-« 

The convergence of the summation is guaranteed by the absolute integrability of 
f(x), which was requisite for the possession of a Fourier transform. The period of 
p(x) is unity; that is, 

p(x + 1) - p(x) 

for all x. 

There will be no regular Fourier transform for p(x) because 

| ^ |p(.v)| dr 

cannot converge, save in the trivial case where p(x) is identically zero. Hence we 
multiply ;»(.y) by a factor y(.v) that dies out to zero for large values of x, both pos- 



Fig. 10.11 The transform in the limit of a periodic function. 
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iti ve and negative. In effect we are bringing the strictly periodic function p(x) back 
to the realm of the physically possible, but only barely so (see Fig. 10.12). Let 

y(x) = e”"; 

then the Fourier transform T(s) of y(x) will be given by 

F(s) = T~ , e-"* /r \ 

The function y(x)p(x) will possess a Fourier transform, 

y(r)p(x) = y(x) 2/(* _ ») 

— 

d r(s) * jre- ,2w " s F(s) 

-oc 

= 2 F(n)I'(s - »). 

-oc 

In s/iflfi-symbol notation, 

2 H « W (* - ») = r( s ) » (iii(s)f(s)]. 

“*OC 

Now let P(s) = Ul(s)F(s). 

This entity Pis) is a whole set of equidistant impulses of various strengths, as 
given by samples of F(s) at integral values of s, and has the property that 

yp D T * P. 

By the convolution theorem we see that P is a suitable symbol to assign as the 
Fourier transform of p(x), and indeed as t—> 0 and yp runs through a sequence 
of functions having p as limit, the sequence I' * P defines an entity P of such a 
type that, as agreed, we may call p(x) and P(s) a Fourier transform pair in the 
limit. 

Taking fix) to be the one-period segment gix) FI(.t), we see that the spectrum 
of a periodic function is a set of impulses whose strengths are given by equidis- 



Fig. 10.12 The convergence factor y applied to a periodic function pix ) renders its 
infinite integral convergent while the convolved I' removes infinite 
discontinuities from a line spectrum Pis). 
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tant samples of F(s), the Fourier transform of the one-period segment. Now 

[ X m(s)F(sK ,2 ™ds = Y ("*° F(s)e +,2nsX ds 

J-x, tZ> n -o 

= 2 F(n)e' Uina 

“OO 

= F(0) + 2 [F(//)e t,27r ' n + conjugate] 
i 

X 

= F(0) 4-22 (^ e ^ cos 2 tthx — Im F sin 27J7 /x) 

t 

ou 

= %+ 2 ( rt it cos 27 thx + i>„ sin 2irnx) 

i 

if — ib„ = 2F(w). And this is precisely the value that was quoted earlier for the 
complex coefficient n„ - ib„. 

The fact that rigorous deliberations on Fourier series generally are more com¬ 
plex than those encountered with the Fourier integral is essentially connected with 
the infinite energy of periodic functions (the integrals of which are not absolutely 
convergent). It is therefore very natural physically to regard a periodic function as 
something to be approached through functions having finite energy, and to con¬ 
sider a line spectrum as something to be approached via continuous spectra with 
finite energy density. The strange thing is that the physically possible functions 
and spectra are often presented as elaborations of the physically impossible. Some 
people cannot see how a line spectrum, no matter how closely the lines are packed, 
can ultimately become a continuous spectrum. This order of presentation is in¬ 
herited from the historical precedence of the theory of trigonometric series, and 
runs as follows (in our terminology). The periodic function III * / has a line spec¬ 
trum IIIF (set of Fourier coefficients). If the repetition period is lengthened to r, 
the lines of the spectrum are packed t times more closely and are r times weaker 
(note compensating change in ordinate scale in Fig. 10.13). Now let the period be¬ 
come infinite, so that the pulse/does not recur. Then the trigonometric sum which 
represented its periodic predecessors passes into an infinite integral, and the fi¬ 
nite integral which specified the series coefficients does likewise. These two inte¬ 
grals are the plus-/ and minus-/ Fourier integrals. 

On the view described here line spectra and periodic functions are regarded 
as included in the theory of Fourier transforms, to be handled exactly as other 
transforms by means of the III symbology, and with the same caution accorded 
to other transforms in the limit. 

As assumed in Fig. 10.13 an infinite array of input impulses at spacing r trans¬ 
forms into impulses at spacing t 1 but not of unit strength. If t > 1, as illustrated, 
then the spacing of the impulses of the transform is less than unity and their 
strength is greater than unity. Thus 
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Fig. 10.13 Deriving the Fourier integral from the Fourier series. 


If we write III(jc/t) D |t III(ts) then the right-hand side consists of unit impulses 
(spaced r - ') while III(jr/r) has stronger impulses (taking r > 1). These relations 
result from the similarity theorem. One can understand that, when a train of brief 
pulses is stretched, each pulse is widened and gains area; the corresponding im¬ 
pulses gain proportionately in strength. 

Gibbs phenomenon. One of the classical topics of the theory of Fourier series 
may be studied profitably from the point of view that we have developed. In sit¬ 
uations where periodic phenomena are analyzed to determine the coefficients of 
a Fourier series, which is then used to predict, it is a matter of practical impor¬ 
tance to know how many terms of the series to retain. Various considerations en¬ 
ter into this, but one of them is the phenomenon of overshoot associated with dis¬ 
continuities, or sharp changes, in the periodic function to be represented. 

It is quite clear that by omitting terms beyond a certain limiting frequency we 
are subjecting the periodic function p(x) to low-pass filtering. Thus, if the funda¬ 
mental frequency is s 0 , and frequencies up to ns 0 are retained, it is as though the 
spectrum had been multiplied by a rectangle function n(s/2s t ), where s c is a cut¬ 
off frequency between ns 0 and (n + l)Sg. It makes no difference precisely where 
s c is taken; for convenience it may be taken at (« + |)% Multiplication of the spec¬ 
trum by FI[s/(2h + l)s 0 ] corresponds to convolution of the original periodic func¬ 
tion p(x) with (2 n + l)s () sine [(2» + Therefore, when the series is summed 

for terms up to frequencies ns 0 only, the sum will be 

p(x) * (2n 4- l)s 0 sinc [(2 n + l)sox]. 

The convolving function has unit area, so in places where p(x) is slowly varying, 
the result will be in close agreement with p(x). 
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We now wish to study what happens at a discontinuity, and so we choose a 
periodic function which is equal to sgn x for a good distance to each side of x = 0 
(see Fig. 10.14). What it does outside this range will not matter, as long as it is pe¬ 
riodic, because we are going to focus attention on what happens near x = 0. Near 
x = 0 the result will be approximately 

(2 n + l)s 0 sine [(2 n + l)s () x] * sgn x. 

We know that 

sine x * sgn x = 2 sine t dt, 

a function closely related to the sine integral Si(x). In fact 

(x 2 

2 I sine t dt - — Si(7rx). 

This function oscillates about — 1 for large negative values of x, oscillates with in¬ 
creasing amplitude as the origin is approached, passes through zero at x = 0, 
shoots up to a maximum value of 1.18, and then settles down to decaying oscil¬ 
lations about a value of +1. If we change the scale factors of the sine function, 
compressing it by a factor N = (2 n + l)s 0 , and strengthening it by a factor N, so 



(a) 



(b) 


Fig. 10.14 (a) A periodic function p{x); (b) an enlargement of area A. 
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as to retain its unit area, then convolution with sgn x will result in oscillations 
about —1 and then about +1 that are faster but have the same amplitude, that is, 

2 

N sine Nx * sgn x = — Si{h]vx). 

The overshoot, amounting to 9 percent of the amount of the discontinuity, remains 
at 9 percent, but the maximum is reached nearer to the discontinuity. The same 
applies to the minimum that occurs on the negative side. 

Now we see precisely what happens when a Fourier series is truncated. There 
is overshoot on both sides of any discontinuity, amounting to about 9 percent, re¬ 
gardless of the inclusion of more and more terms. At any given point to one side 
of the discontinuity the oscillations decrease indefinitely in amplitude as N in¬ 
creases, so that in the limit the sum of the series approaches the value of the func¬ 
tion of which it is the Fourier series (and at the point of discontinuity, the sum of 
the series approaches the midpoint of the jump). In spite of this, the maximum 
departure of the sum of the series from the function, i.e., the error, remains dif¬ 
ferent from zero, and as the maximum moves in close to the step, it approaches 
the precise value of 9 percent that was derived for sgn x, because the parts of the 
function away from the discontinuity have indeed become irrelevant. 

This behavior is reminiscent of that of x 6(x), which is zero for all x, even 
though sequences defining it have nonvanishing maxima and minima. 

Finite Fourier transforms. In problems where the range of the independent 
variable is not from — oo to oc, advantages accrue from the introduction of finite 
transforms; for example, 

F{s,a,b) = \'j{x)e i2 ™dx. 

With such a definition one can work out an inversion formula, a convolution the¬ 
orem, theorems for the finite transform of derivatives of functions, and so on. As 
a particular example of an inversion formula we have 

F,(s,0j) = | f{x) sin 27 rxsdx, 
ft v) = 4 jr F<(s,0,|) sin 2 t txs. 

s= 1 

The right-hand side of the last equation will be recognized as the Fourier series 
for a periodic function of which the segment in the interval (0, £) is identical with 
/(*)• 

It will be evident that the theory of finite transforms will be the same as the 
theory of Fourier series and that the principal advantage of their use will lie in 
the approach. We have seen the convenience of embracing Fourier series within 
the scope of Fourier transforms through the concept of transforms in the limit, 
and we shall therefore also include finite transforms. Thus we may write the fore- 
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J /(x) sin 27 rxsdx = 2 | [' FI(.v)/(x)] sin 2ttxs dx 

and in the general case 



In other words, we substitute for integration over a finite range infinite integra¬ 
tion of a function which is zero outside the old integration limits. 

All the special properties of finite transforms then drop out. For example, the 
derivative of a function will (in general) be impulsive at the points a and b where 
it cuts off, and therefore the Fourier transform of the derivative will contain two 
special terms proportional to the jumps at a and b. It is not necessary to make ex¬ 
plicit mention of this property of the transformation when stating the theorem 
that the Fourier transform of the derivative of a function is i2rrs times the trans¬ 
form of the function; for example, the Fourier transform of n'(*) is 
i27rs.sinc s = 2/ sin 7rs. However, the derivative theorem for finite transforms con¬ 
tains these additive terms explicitly. Thus 

^’ f'(x)e-' 2 ™ dx = i2ir$F(s,a,b) + f(a)e n ™ - f(b)e' ,2irb> . 

Fourier coefficients. If we consider the usual formula for the series coeffi¬ 
cients a„ and b n for a periodic function p(x) of unit period, namely, 

a„ - ib„ = 2 J‘ , p{x)e~' 2nnx dx, 

we note that the integral has the form of a finite Fourier transform. Thus in spite 
of the fact that p(x) is a function of a continuous variable x, whereas the Fourier 
series coefficients depend on a variable n which can assume only integral values, 
Fourier transforms as we have been studying them enter directly into the deter¬ 
mination of series coefficients. The finite transform can, we know, be expressed 
as a standard transform of a slightly different function ri(x)p(x) as follows: 

n(x)p(jr)«r' 2,r ”* dx. 

J —oc 

Our ability to handle transforms can thus be freely applied to the determination 
of Fourier series coefficients. 

As an example consider a periodic train of narrow triangular pulses shown 
in Fig. 10.15rt, 

Z A[10(x - :>)]. 
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Fig. 10.15 Obtaining Fourier series coefficients. 


With the aid of the shah notation this train can also be expressed in the form 

A(10a) * IlI(x), 

whose transform is 


1 

10 


sinc2 10 IH ^' 


We note that the ^ sine 2 (s/10) part of this expression came from 

A(10 x]e- ,2mx dx, 


oo 

—oo 


which, in terms of the periodic train A(10x) * lll(x), is the same as 

n(*)[A(10x) * III(A-)]e' ,2w “ dx. 

Thus by taking the Fourier transform of a single pulse of the train we obtain 
precisely the expression which arose in connection with the series. It is true that 
s is a continuous variable while n is not, but 
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10 


sine 


10 


Ill(s) 


is zero everywhere save at discrete values of s, and at these values the strength 
of the impulse is equal to the corresponding series coefficient. 

In the general case of a function 

/M-XC* 

of any period T, the transform 

F(s)U\(Ts) 

shows that the coefficients are obtained by reading off the same F(s) at different 
intervals s = T _1 . This is illustrated in Fig. 10.15b. 


IMPULSE TRAINS THAT ARE PERIODIC 


A periodic function of x has a transform that is a train of evenly spaced impulses, 
and vice versa. What if the periodic function is itself compused of evenly spaced 
impulses, or if an impulse train is itself periodic? 

Starting from an original function/( a), let a periodic function p(x) of unit pe¬ 
riod be generated by convolution with III(jc). Since p(x) has unit period, its trans¬ 
form P(s) will consist of impulses at unit spacing. Now sample p(x) by multipli¬ 
cation with a train of unit impulses with a spacing X that is less than unity to 
produce a periodic impulse train (Fig. 10.16, bottom left) 

/(*)-[ni(*)*/(x)]Lui(0 


By inspection, 

/(*) D F(s) = [IlI(s)F(s)] * Hl(Xs). 

Thus, a regularly sampled periodic function of x (bottom left) produces a struc¬ 
ture similar to regular replication of a sampled function (bottom right). It follows 
that f(x) can be expressed in two ways, namely 


/(*) = [iiim * /Ml £ ill (i) = [/M L III 00] » him. 


Only the first of these ways is illustrated; there therefore exists another diagram 
whose top and bottom rows are the same as in Fig. 10.16 but whose central row 
is replaced by X ’III (x/X)f(x) on the left and by III(-Xs) * F(s) on the right. 

When the discrete Fourier transform is implemented, both the data set and 
the discrete transform are equivalent to regular impulse trains. Their relationship 




Fig. 10.16 A periodic impulse train (bottom left) generated from f(x) by first repli¬ 
cating (middle left) at unit interval and then sampling at interval X. 

The corresponding transforms on the right show sampling at unit inter¬ 
val (middle right) followed by replication at interval 1/X. Ticks on all 
axes are at ±1. 


is the same as exists between the central clusters of the bottom row. Fig. 10.16 will 
prove helpful in understanding the phenomena of leakage and aliasing that may 
cause the coefficients of F(s) to differ from the values of F(s), as described in 
Chapter 11 in the section entitled "Is the Discrete Fourier Transform Correct?" 


THE SHAH SYMBOL IS ITS OWN FOURIER TRANSFORM 

The shah symbol III(jc) is defined by 

IX) 

moo = - ») 
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and therefore, in accordance with the approach being adopted here, is to be con¬ 
sidered in terms of defining sequences. If, as asserted, its Fourier transform proves 
to be III(s), then it too will be considered in terms of sequences. 

We proceed therefore to construct a sequence of regular Fourier transform 
pairs of ordinary functions such that one sequence is suitable for defining IlI(x), 
and we then see whether the other sequence defines III(s). 

Consider the function 

f(x) = 2 ) e nT 

n — —<x. 

For a given small value of t (which we shall later allow to vary to generate a se¬ 
quence), the function f(x) represents a row of narrow Gaussian spikes of width r, 
the whole multiplied by a broad Gaussian envelope of width t 1 (see Fig. 10.17). 
As r —*■ 0, each spike narrows in on an integral value of x and increases in height. 
For any value of x not equal to an integer, we can show that f(x) —»0 as r —>0 
and, in addition, the area under each spike approaches unity. The sequence is 
therefore a suitable one for defining a set of equal unit impulses situated at inte¬ 
gral values of x. 

The function f{x) possesses a regular Fourier transform, since \f{x)\ is inte¬ 
grate, and there are no discontinuities. The Fourier transform F(s) is given by 

no 

P( s ) — ^ c -^rm 2 e rrt \s-mf 

tn • -tx 

One way of establishing this is to note that the factor 

r _1 2) e - ’"' V ~ n? 

n m -oo 

is periodic, with unit period, and hence may be expressed as a Fourier series. The 
theory of Fourier series is a well-established branch of mathematics that we are 
entitled to draw upon here, as long as we do not attempt to make the self- 



Fig. 10.17 A transform pair for discussing the shah symbol. 
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transforming property of the shah symbol a basis for reestablishing the theory of 
Fourier series. The Fourier series is 

oo 

^ e~ irrm2 cos 2-nmx. 

m * -oo 

oo 

Therefore f(x) = ^ ^-nrW^-jn-V cos 2-77 mx 

m = -00 
00 

_ y g-in^m 2 ^ - irr 7 jr^ZTTjmx 

m = -00 

By applying the shift theorem term by term, we obtain F(s) in the form quoted 
above. 

The function F(s) is a row of Gaussian spikes of width r with maxima lying 
on a broad Gaussian curve of width r _I . As before, it may be verified that as t —> 0 
a suitable defining sequence for the shah symbol results. 
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PROBLEMS 

1. Show that a periodic function p{x) with unit period can always be expressed in the 
form III(x) * f(x) in infinitely many ways, and relate this to the fact that infinitely many 
different functions can share the same infinite set of equidistant samples. 

2. Express the periodic pulse train 

S n[io(x - »i)j 


in the form Ill(x) * f(x) in three distinct ways. 
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3. Series coefficients. Determine the Fourier series coefficients for the functions of period 
equal to unity which, in the interval — \ < x < are defined as follows: 

(a) cos 7 t.t, A(2*), n(2r) - 

(b) A(8x-1),(l -4 x)H(x), 

(c) e - 4x*,e M,e x H(x). 

4. Interpolation. The following sample set defines a band-limited function: 

... 0,10,30,50,50, -40, -35, -10, -5,0, ... 

All samples omitted are zero. Establish the form of the function by numerical interpo¬ 
lation. What is the minimum value assumed by the function? 

5. Undersampling. A certain function is approximately band-limited, that is, a small frac¬ 
tion n of its power spectrum in fact lies beyond the nominal cutoff frequency. It is sam¬ 
pled at the nominal sampling interval and reconstituted by the usual rules. Use the in¬ 
equality 

f(x) « I* |F(s)| ds 

to examine how great the discrepancy between the original and reconstituted functions 
can become. 

6. Undersampling ordinate and slope. The approximately band-limited function men¬ 
tioned above is subjected to ordinate-and-slope sampling. Use the inequality 

/'(*) ^ 2tt [~ |sF(s)| ds 

J -oo 

to show that the discrepancy between the original and reconstituted functions can be 
serious, even when p is small. C> 

7. Sampling in the presence of noise. A little noise is added to a band-limited function. 
Before sampling, one subjects the noisy function to filtering that eliminates the noise 
components beyond the original cutoff. However, the function is still contaminated 
with a little band-limited noise Examine the relative susceptibilities of ordinate-and- 
slope sampling and of ordinary ordinate sampling to the presence of the noise. 

8. Self-convolution. A finite sequence of equispaced impulses of finite strength 

i7 0 S(.y) + fl, 8(x - 1) + ... + 17,, S(y - it) 

is convolved with itself many times, and the result is another sequence of impulses 

S(x - /). 

Combine the central-limit theorem with the sampling theorem to show that a 
graph of «, against; will approach a normal distribution. State the simple condition that 
the coefficients i7 0/ 1?,,..., a„ must satisfy. 

9. Self-convolution. In the previous problem, practice with simple cases that violate the 
condition, and dev elop the theory that suggests itself. 
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10. Gibbs overshoot. Show that the overshoot quoted as around 9 percent in the discus¬ 
sion of the Gibbs phenomenon is given exactly by 


l; 


sine x dx. 


11. Sampling a bandpass signal. A carrier telephony channel extends from a low- 

frequency limit /, = 95 kilohertz to a high-frequency limit f h = 105 kilohertz. The sig¬ 
nal is sampled at a rate of 21 kilohertz, and a new waveform is generated consisting of 
very brief pulses at the sampling instants with strength proportional to the sample val¬ 
ues. Make a graph showing the spectral bands occupied by the new waveform, and 
verify that the original waveform could be reconstructed. Show that in general the crit¬ 
ical sampling rate is 2/,, divided by the largest integer not exceeding - /,). 

12. Interlaced sampling. In the previous problem, show that 2 (f h - /,) is in general too 
slow a sampling rate to suffice to reconstitute a carrier signal. Show that by suitably in¬ 
terlacing two trains of equispaced samples the av erage sampling rate can, however, be 
brought down to twice the bandwidth 


13. Analogue filtering of data samples. A band-limited signal X(f) passes through a filter 
whose impulse response is /(f). The input and output signals X(t) and Y(t) can be rep¬ 
resented by sample values X, and V,. Show that 

{Y,} = {/,} * {X,} 

and explain how to derive the sequence {/,}. 

14. Input from output. In the previous problem the input signal samples are {X,} = 
{1 234 5 ... f, and the sequence {/,} describing the filter is {1 2 1}. Show that the out¬ 
put sequence {Y,} is {1 4 8 12 .. } and that it is possible to work back from the known 
output and determine the input by evaluating 

{1 -2 3 -4 5 ... } * {1 4812 ...}. 


15. Prediction by recursion. In the previous problem, verify numerically that a particular 
output signal sample can be expressed in terms of the history of the output plus a 
knowledge of the most recent input signal sample, that is, 

Y, = n,Y,-, + a 2 Y,_ 2 + ... + (3X r 


Show that the coefficients a,, a 2 , ... and /3 are given in terms of the reciprocal sequence 


by 

and 


{K, K , K 2 ...} = {/,}-' 

{«! « 2 • ■ ■ } = ~~j7~ {K| X 2 Kv ...} 

*0 



16. Bandpass filter. The input signal to a filter ceases, but the output continues, with each 
new sample deducible from the previous ones by the relation 

Y, = «iY,-, + a 2 Y^2 +- 
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Show that 

y (0 = [a 1 5(<- l) + a 2 fi(f- 2 )+ ... ] * Y(f). 

In a particular case, there are only two nonzero coefficients: 

y, = i.65y r ., - o.9y, 2 . 

The first two output samples immediately after the input ceased were each 100; calcu¬ 
late and graph enough subsequent output values to determine the general character of 
the behavior. Show that a damped oscillation Y{t) = c~"' cos [w(f — a)] satisfies the 
convolution relation given above when 

c*| = 2e " cos to 

and a 2 = -e -2 " 

Is this band-limited behavior? 

17. General filter. In the previous problem, show that the series for y, contains only a fi¬ 
nite number of terms if the filter is constructed of a finite number of inductors, capaci¬ 
tors, and resistors. Hence show that the output due to any input signal is deducible, for 
a filter whose internal construction is unknown, after a certain number of consecutive 
sample measurements have been made at its terminals. How would you know that 
enough samples had been taken? t> 

18. Unraveling a black box. The input voltage X(t), and output voltage Y(t) of an electri¬ 
cal system are sampled simultaneously at regular intervals with the following results. 


X(/) 15 10 6 2 1 00000 

Y(t) 15 15 7.5 -2.75 -2.5 


Calculate the missing values of y(f), and also calculate what the output would be if, af¬ 
ter some time had elapsed, X(t) began to rise linearly. 

19. Shah symbol. Show that 

x. 

2 e~' 2 ™ = HI(s). 

n - -x 

20. Sum of samples proportional to integral. A bandlimited signal of long but finite du¬ 
ration is sampled at regular intervals T and the sample values are summed. Show that, 
provided a certain condition is met, the sum will be the same if the same total number 
of samples are taken, but at intervals that alternate between T - b and T + b (inter¬ 
laced samples). 

21. Computer graphics. A computer printout presents a long string of numbers which 
have to be graphed Smith plots the points by hand, and as they seem to lie on a rea¬ 
sonably smooth curve, he draws a smooth curve through them by hand. Johnson, on 
the other hand, has the numbers plotted automatically using a computer program that 
joins successive points by a straight line. Smith says, "I can see by the sharp corners in 
your mechanical-looking curve that you have introduced spurious high frequencies 
that have no basis in fact." Johnson says, "My curve is more reliable because no sub¬ 
jective judgment enters into it." Robinson says, "I have put the Smith and Johnson 
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curves through my Fourier analyzer, and it is true that Johnson has a small high- 
frequency content that is absent from Smith's, but it is practically undetectable. The 
main discrepancy is that Smith's spectrum is noticeably stronger than Johnson's except 
for the d-c and neighboring low frequencies. If anything, it seems to be Smith who has 
added extra components, but in the middle-frequency range." Lee says, "Maybe the 
Smith curve is best and the mechanical plotting method has subtracted components." 
The time has come to do better than give a qualitative opinion; what do you say? 

22. Update operator. Complicated input waveforms are to be applied to a linear time- 
invariant system and the response is to be computed step by step from an equation of 
the form 

A V 2 (t) = U{Y/,(0}, 

where U describes an operation to be carried out on the part of !/,(/) that has been ap¬ 
plied up to any particular moment. Then, after a step It in time, exactly the same op¬ 
eration will be carried out on the updated segment of V,(/) and a new increment in 
V 2 (t) will be computed, and so on. What is this operation U? In what way might this 
method of computation be superior to simply convolving V^t) with the impulse re¬ 
sponse I(t)? 

23. Associativity of multiplication and convolution. Two functions are to be convolved 
but first one of them is to be sampled. Investigate whether [/(x)III(x)] *#(*) = 
fix) * [mx)8(x)}. 

24. Parseval's theorem. If p(x) is real and periodic with period T, show that 

y {7 2 M *)] 2 iix ~ 4 + 2 2 + * 2 )- 

where a n and b„ are the Fourier coefficients of the Fourier series for p(x). 

25. Interpolation. Values of a function/(v) arc given at all integral values of .y. 

(a) Show that 

fix) = 5) fit 0 sine (x - h) 

II ■ * Xi 

is an interpolation formula that yields f(x) correctly for any value of x, provided 
that f(x) contains no frequencies as high as 0.5 cycle per unit of x or higher. 

(b) Show that this interpolation formula is expressible as a convolution between sine x 

and v /(n)fi(.t - «). 

26. Spline interpolation. Let /(h), f(n + a), f(n + 2a), and f(n + 3a) be four consecutive 
data values (labeled A, B, C, and D). It is proposed to interpolate as follows. A cubic 
curve (shown broken) will be put through A, B, C, and D (a cubic can be put through 
six points) and two extra conditions will be imposed. The slope at B will be the same 
as the slope of the line AC and the slope at C will be the same as the slope of the line 
BD. The arc BC will be accepted as the interpolation; then an arc CD will be determined 
in the same way using the points B, C, D, E, and so on. This is a form of spline inter¬ 
polation, so called by analogy with the flexible splines used by draftsmen as a guide in 
drawing curved lines. Show that the operation described is expressible as convolution 
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with 

{ 0.5rt‘ 3 (3|x| 3 - 5fl|x| 2 + 2n 3 ) 0 < |x| < a 

0.5a 3 ( —|x| 3 + 5fl|x| 2 - 8a 2 ]x| + 4 a 3 ) a < |x| < 2a 

0 |x| > 2n 

and work out the corresponding transfer function. Obtain the sequence of coefficients 
for midpoint interpolation and explain the value obtained for their sum. 



27. Lagrange interpolation. Values of a function/(x) are given for all integral values of x 
and interpolated values at x = n + p, where 0 < p < 1, are calculated from the La¬ 
grange four-point formula. 

/(” ~ 1 ) , /(”) 

/(» + P) - ~P(P - 1)(P “ 2 )~— -+ (p 2 - 1 XP ~ 2) J — 

/(» + 1 ) , /(« + 2 ) 

~P(P + !)(/' - 2)-— -+ p{p~ - 1)-— - 

The interpolated value is a linear function of the given values, but can it be expressed 
in the form of a convolution, in which case I agrange interpolation could be character¬ 
ized as a filtering operation with a distinctive transfer function? 

28. Finite number of samples. By measuring the flow in a river at a suitable site on differ¬ 
ent dates it is possible to establish a calibration curve relating the flow in cubic meters 
per second to the height of the water at a single height gage. After that the height can 
be measured automatically and telemetered to a central point where calculations can be 
made regarding future water storage in the dam receiving the discharge and future hy¬ 
droelectric power production. In a certain netw'ork where the measurements from each 
site were made once a day, the predicted height of the dam based on the first 6 months 
of operation came out all wrong. Computer programmer Lee said, "Summing the daily 
flows and multiplying by 24 hours, which is what my program did, can only be an ap¬ 
proximation to the actual volume delivered in 6 months, which is, strictly speaking, an 
integral, not a sum." Mathematician Long said, "Fven if the height of a river is a 
bandlimited function of time, and even though we use 180 samples, there are an infi¬ 
nite number of functions, all with the same band limit, that pass through the 180 sam¬ 
ple points. The key virtue of the sampling theorem is to permit interpolation, but the 
interpolation formula require s an infinite number of samples. We implicitly assumed that 
sample values prior to the first were zero. I have a proof that the set of functions, all 
passing through the N sample points, do not even have to be approximately the same, 
but may differ from each other by more than | A41, for any M no matter how large." Give 
your opinion on each sentence of the quoted statements. If you were the hydrologist, 
what would you have said? 
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29. Sampling rate versus interpolation quality. A data stream arrives in the form of a volt¬ 
age which contains very little at frequencies above 1 Hz but enough to cause concern 
over aliasing. A careful investigation reveals that S(f) = exp(-7r/ 2 ) is as good a 
representation of the voltage spectrum as any. A single pulse of the form 
V'o(f) = exp (-rrt 2 ) has this spectrum, so it is used for test purposes. Asampling device 
looks at V t ,(f) for 1 millisecond every 0.5 second. The samples are subsequently used to 
reconstruct a waveform by linear interpolation for display on an oscilloscope. The re¬ 
sulting polygon is only a rough approximation to the waveform V 0 (f). Over the inter¬ 
val from t = — 1 to t = +1, what is the mean absolute error? Does the phasing of the 
samples relative to the time of occurrence of peak signal make a difference? If sine func¬ 
tion interpolation was used, more elaborate arrangements would be needed but what 
would the error be reduced to? If linear interpolation were retained but the sampling 
rate were doubled, what would the error be? What would you recommend? 


30. Aliasing. It is necessary to predict the sunspot number 6 months ahead for scheduling 
frequencies for overseas radio communication. Each day the sunspot number is deter¬ 
mined, as it has been for the last two centuries; at the end of each month the list is pub¬ 
lished, together with the mean value for the month. The monthly means, when 
graphed, give a rather jagged curve, not suited to the prediction of trends, so for each 
month a 12-month weighted running mean Rq is calculated from the formula 


24 12 12 12 12 12 12 12 


12 12 


R 4 Rs R b 
12 + 12 + 24 


Naturally, this quantity is only available after a delay. From Fourier analysis of Rq, it is 
found that although R,', is reasonably smooth, it nevertheless tends to have wiggles in 
it with a period of about 8 months; in fact, the Fourier transform peaks up at a fre¬ 
quency of 1/8 4 cycle per month. 

Natural periodicities connected with the sun include the 11-year cycle and the 27- 
day interval between times when the sun presents roughly the same face to the earth, 
so it is hard to see how 8-month wiggles would have a solar origin. Can you explain 
why the wiggles are there? 


31. Theorem for band-limited functions. An article in a current technical journal was be¬ 
ing summarized before a discussion group by Smith, who said, "The author refers to a 
property of band-limited signals according to which two consecutive maxima cannot 
be more closely spaced than «T, where T is the critical sampling interval. Does anyone 
know this theorem?" Lee said, "It's more or less obvious. Consecutive maxima of a sine 
function range from a greatest separation equal to 2.49 T down to 2 T in the limit. A su¬ 
perposition of such sine functions, which after all is what a band-limited function is, 
cannot possess maxima closer than 2 T. Therefore, n = 2." Yanko, who had been think¬ 
ing, then pointed out that sin 2 1 - exp [ — (f/1000) 2 ] would be adequately sampled at 
intervals T = 1 and made a sketch to show that the function possessed two rather 
closely spaced zeros at A and B. "I am pretty sure," he said, "that the integral of a band- 
limited function is also band-limited. Therefore, the maxima occurring at A and B in the 
integral of my function are spaced more closely than 2 T. What's more, I can make them 
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as close as I please by adjusting the amplitude of the sine wave." Confirm or disprove 
the various statements. What is your value of a? 


32. Harmonics. The rails of an electric train system deliver d-c power obtained by 12-phase 
rectification of 60-hertz power to the locomotive, and the signals that are depended 
upon for safety precautions, such as keeping a maximum of one train in any one block, 
are delivered along the same rails but at audio frequency. (Signals are in a binary code 
generated by switching between two frequencies in the 5- to 10-kilohertz range, differ¬ 
ent pairs of frequencies being used in adjacent blocks.) The heavy currents have the 
same direction in the two rails and are nominally equal ("balanced"). The audio cur¬ 
rents, on the other hand, are in opposite directions and are picked off the rails by two 
noncontacting ferrite-core coils whose outputs are combined so as to double the signal 
pickup and, in theory, cancel the ripple at power frequencies. As a final step, the signal 
frequencies are selected out by "maximally flat" quartz filters. In spite of this, the sig¬ 
naling system is not reliable enough to depend on for automatic train control. 

The term "power frequencies" was used advisedly because the d-c motors draw 
ripple currents at 720 hertz (and harmonics) from the rails. To explain: let 


1,(0 = {* cos <v 


when cos uyj > 0 
when cos io 0 t < 0, 


where <e 0 = 2tt X 60 Hz and let 

HO = 0(0 + ~ 720) + H(f — 720) + + HH ~ tsi )- 

which is almost pure d-c as a result of the combining of the 12 staggered waveforms 
but in fact has a fluctuating component with a fundamental frequency of 720 hertz. If, 
as happens when the train starts, the d-c component of /(f) is 10,000 amperes, calculate 
the number of amperes flowing in each harmonic that falls in the range 5 to 10 kilo¬ 
hertz. 

Consultant A makes wise remarks about the frequency stability of the audio oscil¬ 
lators, bit rate, signal bandwidth, filter bandwidth, and out-of-band rejection level but 
as an interim measure recommends inspecting and replacing all quartz filters that do 
not comply with specifications, and wire-brushing the rails. Consultant B states that the 
waveform /(f) exhibits a scalloped form as illustrated and that the waveform picked up 
by the ferrite coils has a sawtooth form because a coil responds to the derivative of the 
flux through it. To suppress this sawtooth interference component in the desired audio 
signal, he proposed to differentiate once again; then the interference component will be 
strictly localized in time, in the form of brief pulses which may be clipped at a level that 
does not affect the desired sinusoidal signals. Is this right? 





33. Convolution of band-limited functions. The acoustic energy flux incident on an air¬ 
port bus stop as an aircraft takes off is to be measured with precision. The plan is to 
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digitally record samples of the air pressure p{t) and velocity v(t). Preliminary investi¬ 
gation reveals that both waveforms are band-limited and adequately sampled when 
the sampling interval is one unit of l. Then the energy flux per unit area is given by 
/\ P(t MO This procedure was adopted in the hope of avoiding the uncertainty of 
basing an energy measurement on pressure alone, especially in the presence of a si¬ 
multaneous rush of hot fumes. A young systems-thcory student on a summer job 
pointed out that the theoretically correct integral cannot be obtained from discrete data 
and offered to write a program for getting a least-mcan-squares estimate of the integral 
from the discrete data. The engineer on the job said he always just took the products of 
the data values and added them up. "As a matter of fact," he said, "when I used to do 
this by hand I found that if you throw away every second value on both channels you 
only have half the work and you still get exactly the right answer." What is the truth of 
the matter? 

34. Fourier series. Euler published the formula x/2 - sin x — | sin 2x + 5 sin 3x — ... 
well before Fourier's work on trigonometric series. Is it correct? What is there about 
this formula that causes Euler not to receive the credit for Fourier's scries? 


35. Binomial coefficients. The rth binomial coefficient B(r, n) for a given 11 is given by 
n!/r!(/i - r)!. Write a MATLAB M-file whose first line reads function [y] = binom(n) so 
that the string of n + 1 coefficients for a stated 11 can be generated. For example, typing 
binom(5) should produce 1 5 10 10 5 1. 

36. Improved notation for stretched shah function. When IIl(.v) is stretched by an integer 
factor L to give III(a/I.), the impulses that were originally at unit spacing are now 
spaced by L units; but they are no longer unit impulses: they have strength L. Moun- 
tararat says, "1 propose an improved notation lll t (jr) to stand for unit impulses at spac¬ 
ing L. In the old notation my function would be represented as (1/L)lll(.x/L)." Would it 
be right to suppose that, in the improved notation, the Fourier transform of III/M 
would be ( 1 / 1 ) 111 , ,(s)?t> 


37. Inverse sampling theorem. A signal waveform has a duration T; consequently the sig¬ 
nal spectrum is fully determined by equispaced values separated by a frequency inter¬ 
val T *. Is it necessary for one of the frequency values to be zero? For example, can the 
area under the signal be determined from spectral samples at frequencies that do not 
include / = 0? t> 

38. A Fourier series. Show that sin x can be expanded as a cosine series as follows: 

1 2 2 2 

— 7r sin x = 1 - — cos 2x - — cos 4.r — - - cos 6.v — ..., 0 ^ x ^ rr 

and explain how an odd function can be expanded as a sum of even functions. D> 


39. Cotangent as a replication. See whether the cotangent function can be represented as 
a superposition of l/.r functions suitably displaced along the *-axis so that their poles 
coincide with the poles of cot x at .r = 0, ±it, 2tt, .... In other words, investigate 


cot x = 



1 

— k-n 


.O 
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40. Checking analysis by computer. It has been suggested that III(r) sgn x has Fourier 
transform -i cot its. The innermost pair of impulses — S(x + 1)4- 5(x — 1) has FT 
-2i sin 2ns, then transforming pair by pair suggests that 

2 2 sin 277 ks = cot 7rs. 

k-l 

To check for a sign error, a missing factor of 2, or more serious errors, compute both 
sides for a single value of s; for example, does sin 1° + sin 2° + sin 3° ... add up to 
^ cot Graph the sum of N terms versus N and discuss your finding. > 



■ n 


The Discrete Fourier Transform 
and the FFT 


If one wishes to obtain the Fourier transform of a given function, it may happen 
that the function is defined in terms of a continuous independent variable, as is 
most often the case in books, especially in lists of transform pairs. But it may also 
happen that function values are given only at discrete values of the independent 
variable, as with physical measurements made at regular time intervals. Regard¬ 
less of the form of the given function, if the transform is evaluated by numerical 
computing, the values of the transform will be available only at discrete intervals. 
We often think of this as though an underlying function of a continuous variable 
really exists and we are approximating it. From an operational viewpoint, how¬ 
ever, it is irrelevant to talk about the existence of values other than those given 
and those computed (the input and output). Therefore, it is desirable to have a 
mathematical theory of the actual quantities manipulated. 


THE DISCRETE TRANSFORM FORMULA 

Questions of discreteness also arise in connection with periodic functions. A pe¬ 
riodic function is describable by a sequence of coefficients at discrete intervals (of 
frequency), but this situation may be viewed as a special case of continuous fre¬ 
quency The transform is then regarded as a string of equally spaced delta func¬ 
tions (Fig. 11.1) of strengths given by the coefficients. What if this transform were 
itself periodic? Then the original function would also reduce to a string of delta 
functions. With both function and transform now being periodic, all the infor¬ 
mation about both would be limited to two finite sets of coefficients: the strengths 
of the delta functions. Periodic impulse trains were discussed earlier, towards the 
end of Chapter 10 

Thus the practical situation where a finite set of values is given and a finite 
set is computed does actually lie within the continuous theory. Flowever, it pays 
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Fig 11.1 (a) A periodic function pit) has a transform Pi /) which is a string of eq- 

uispaced delta functions; (b) a periodic function which is a string of 
equispaced delta functions, has a transform Qi /) which is also a string of 
equispaced delta functions and the string is periodic. 


to start afresh rather than to force the theory of the discrete Fourier transform into 
the continuous framework. The reason is that the discrete notation is concise and 
reasonably standardized. 

To retain some physical ties, let us think in terms of a signal that is a func¬ 
tion of time; but to recognize the discreteness of the independent variable, let us 
use the symbol t, which we agree can assume only a finite number N of consec¬ 
utive integral values. Furthermore, we agree that r cannot be negative. Thus, be¬ 
fore entering into the realm of the discrete Fourier transform, we first make, if 
necessary, a change of scale and a change of origin. For example, suppose that a 
voltage waveform v(t) is half a period of a cosinusoid of period 1 second (Fig. 11.2): 


, . fcos 27 Tt 

= { 0 


-0.25 < t < 0.25 
otherwise 



Fig. 11.2 A function of the continuous variable t and one way of representing it 
by eight sample values. 
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■ TABLE 11.1 


■ TABLE 11.2 

t 

(milliseconds) 

v(t) 

T 

/( t) 

250 

0 

0 

0 

-150 

0.588 

1 

0.588 

-50 

0.951 

2 

0.951 

50 

0.951 

3 

0.951 

150 

0.588 

4 

0.588 

250 

0 

5 

0 


and that samples are taken at intervals of 1U0 milliseconds. Table 11.1 shows sig¬ 
nal values as a function of t but Table 11.2 shows how it is to be converted into a 
function /(r) of discrete time r before proceeding. In general, if the sampling in¬ 
terval is T and the first sample of interest occurs at f — f(i/ then 

/(t) = v(t 0 + tT), t = 0,1,2, —1. 

In what follows, /(r) forms the point of departure. It will be noticed that no 
provision is made for cases where there is no starting point, as with a function 
such as exp (-f 2 ). This is in keeping with the practical character of the discrete 
transform, which does not contemplate data trains dating back to the indefinitely 
remote past. A second feature to note is that the finishing point must occur after 
a finite time. However, it need not come at t = 5 as in Table 11.2; one might choose 
to let t run on to 15 and assign values of zero to the extra samples. This is a con¬ 
scious choice that must always be made. It may be important; for example. Table 
11.2 does not convey the information given in the equation preceding it—that fol¬ 
lowing the half-period cosine, the voltage remains zero. The table remains silent 
on that point, and if it is important, the necessary number of zeros would need 
to be appended. 

By definition, /(r) possesses a discrete Fourier transform F(v) given by 

F(i') = N' 1 2 f(r)e-^ fN K (1) 

r-o 

Just as the leading coefficient a 0 in the Fourier series expansion of a periodic func¬ 
tion equals the mean of the function values, so the leading value F(0) of the dis¬ 
crete Fourier transform equals the mean N" 1 ^/(r) of the values of /(t) Respect 
for prior convention is the reason for the factor N 1 in the definition. In comput¬ 
ing practice, as distinct from formal definition, it is efficient to combine the N~ l 
with later normalizing factors or graphical scale factors than to prematurely mul¬ 
tiply every element of F(i/) by N~‘. 

The quantity v/N is analogous to frequency measured in cycles per sampling 
interval. The correspondence of symbols may be summarized as follows: 
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Time 

Frequency 

Continuous case 

/ 

/ 

Discrete case 

T 

v/N 


The symbol v has been chosen in the discrete case, instead of/, to emphasize 
that the frequency integer v is related to frequency but is not the same as frequency 
/. For example, if the sampling interval is 1 second and there are eight samples 
(N = 8), then the component of frequency / will be found at v = 8/; conversely, 
the frequency represented by a frequency integer v = 1 will be £ hertz. 

Given the discrete transform F(r>), one may recover the time series /(r) with 
the aid of the inverse relationship 

/M = s' nrY 2 ****- (2) 

«< = 0 


To see that this is so, we first verify the fact that 




I’-O 



r = r' 
otherwise. 


One way is to picture the summation as a closed polygon on the complex plane, 
except when r = r', in which case the polygon becomes a straight line composed 
of N unit vectors end to end. (The variable t' is taken to assume values 0, 1, ..., 
IV — 1; if larger values were allowed, for example if t — t' could become equal 
to N, 2 N, ..., the summation would equal N for r = r' mod N.) Another way to 
think of this is by analogy with the orthogonality relation of sinusoids of differ¬ 
ent frequencies, a viewpoint that is aided by rewriting it 

y e i2v\r/N)r e an{v'/Nyr _ V — V 

T o \0 otherwise. 

To establish the inverse discrete transform, introduce a dummy variable t' for 
convenience, and substitute (1) into the right-hand side of (2): 


2 F{v)e ,2Mv/Ny 
<--0 


N -1 N - 1 

y' l y f(r)c ,27r W N ) T e ,2ir (v/Ny 

-0 T = 0 


= N 1 
= N 1 


N-I N -1 


E /( T ) 2 r <2 ^ r/N)(T "° 


T 0 V-{\ 



t = r' 

T # T' 


= /(T')- 

The definition of the inverse differs by having a positive sign in the exponent and 
in having no preceding factor N l . 
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From the inverse transform we see that only N integral values of the frequency 
integer v are needed and that they range from 0 to N - 1 just as with the discrete 
time r. It certainly sounds reasonable that a function defined by N measurements 
should be representable after transformation by just N parameters. Even when 
the values of/are real, the values of F are in general complex and, as will be seen 
below, one must be careful how to count complex numbers. The fact that v ranges 
over integer values, whereas the frequency v/N is fractional, is the reason for in¬ 
troducing the integer v; mathematical convenience takes priority over physical 
significance. 

In order to regain our physical feeling for numerical orders of magnitude, let 
us consider a record consisting of 1,024 samples separated by 1-second intervals. 
We expect this to be representable by a Fourier series consisting of a constant term 
and multiples of a certain fundamental frequency. The fundamental period should 
be 1,024 seconds, corresponding to a fundamental frequency 1/1,024 hertz. The 
highest frequency needed will be 0.5 hertz, which has two samples per period. 
This will be the 512th harmonic. The reason that v assumes 1,024 values, whereas 
the number of frequencies is only 512, is as follows. If the values of /(t) are real, 
as is usual in records of physical quantities, there are 1,024 real data values. Now 
the transform F(v) has 1,024 complex values which would require 2,048 real num¬ 
bers to specify except that F(0) and F(N/2) have no imaginary part see (Eq. 1)] 
and half the remaining values of F( v) are complex conjugates of the other half. 
This is because /(r) is real (Chapter 2). If /(r) were complex, there would be 2,048 
real data values and F(v) would require 2,048 real numbers for its specification. 

Since the highest frequency reached is 0.5 hertz, it is apparent that v/N, which 
reaches a maximum value of 1,023/1,024, is not a strict analogue of frequency. For 
instance, where v = 724, v/N = 0.707 hertz and, as we have seen, frequencies 
above 0.5 hertz are neither required nor can be represented by samples at 
1-second intervals. Rather, v = 724 corresponds to a negative frequency 
-300/1,024 hertz. 

This anomaly is a distinct impediment to the visualization of the connection 
between the Fourier transform and the discrete Fourier transform. One way to 
bring the two into harmony would be to redefine the discrete transform in terms 
of summation over negative and positive values, although it might be objected 
that negative subscripts are not permitted in some computer languages. Figure 
11.3b shows how a signal v(t) and its transform S(/) might be made to correspond 
with /(t) and its discrete transform F(v). Alternatively, as in Fig. 11.3c, it could be 
arranged that r = 0 corresponds to f - fa this would not prevent the small neg¬ 
ative values of frequency labeled A from corresponding to large positive values 
of v labeled B. 

Finally, another way of looking at this, which is customary, is to lift the re¬ 
striction of r and v to values from 0 to N — 1 and to allow all integral values, in¬ 
cluding negative values. The function values assigned are on the basis that /(t) 
and F(v), in their extended sense, are periodic, with period N. Thus 

f{j) “ f( T - N) = /(t ± IN) = - . - 

F( v) = r(*/ ± N) = F(v ±2 N)= _ 
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fir) 


i. nv) 


T N -1 


(c) 


\ \ \ 


J 


\ \ \ v \N-1 

Phase 


Fig. 11.3 (a) A function and its Fourier transform; (b) and (c) two ways of repre¬ 

senting the function by N samples and the corresponding discrete 
Fourier transforms, shown by modulus (dots) and phase (small dots). 


This plan will be adopted here. Under this plan, the basic transform and its in¬ 
verse may be written 


N 2-1 


I» = 

N 1 X ^ T )e-ai*ym r 

(3) 


t- -N/2 



N/2 -1 


/( T) = 

5) 

(4) 


>■ - - N/2 


and v/N may be identified with frequency measured in cycles per sampling in¬ 
terval over the range —=£ v If the sampling interval is T, the frequency 

measured in hertz is r/NT. 

In Fig. 11.4, we see a way of visualizing /(r) and F(e) as having cyclic de¬ 
pendence on r and v. The upper type of diagram is helpful in making a connec¬ 
tion with our previous experience e.g., to take the autocorrelation of a sequence. 
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Fig. 11.4 Cyclic (above) and standard (below) representations of a sampled rectan¬ 
gle function, its triangular autocorrelation, and its transform. 


we imagine /(r) to be rotated, in the top left-hand diagram, relative to itself]. Mul¬ 
tiplication of corresponding values followed by summation gives a value of the 
autocorrelation, and we can see how the result ties in with our previous knowl¬ 
edge that the autocorrelation of a rectangle function is a triangle function. This il¬ 
luminates the lower diagrams where the original form of indexing, starting from 
zero, obscures the simple shapes. 


CYCLIC CONVOLUTION 

If we convolve two sequences, one having m elements and the other n, then the 
convolution sum, or serial product, will have m + n — 1 elements (p. 32). In par¬ 
ticular, if we deal with sequences having N elements, then the convolution of two 
such sequences will not itself be containable in an N-element sequence. Figure 
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11.4 (top center) coped with the desire to exhibit the triangular autocorrelation of 
two rectangles by packing the sequence expressing the rectangle with extra ze¬ 
ros. Three-fourths of the elements shown at the top left are zeros, and at the top 
center there are still plenty of zeros left to witness to the isolated nature of the tri¬ 
angular island. 

Suppose now that N is kept constant while the number of nonzero elements 
at the top left is increased. When the rectangle extends more than halfway around 
the circle, the outer ends of the triangle overlap. The result will be a flat, nonzero 
segment in the region of overlap. Clearly, the result is wrong if we are looking for 
the triangular autocorrelation. However, the operation exists in its own right, and 
may be defined as cyclic convolution. 

The cyclic convolution integral h(0) of two periodic functions /( ■) and g( ) 
with period 2tt is defined as 

m = \^f(0')s(0-0’)de'. 

The cyclic convolution sum li( t) of two N-element sequences /(r) and g(r) is 
defined as 


Kr ) = S' f ( T ') g[r - r ' + NH(t' - t)], 

t'— 0 

where H( ) is the Heaviside unit step function. Because r — r' may range from 
— (N — 1) to N — 1 as t and r' range from 0 to N — 1, a term N must be added 
to t — t' when r' > r to bring r — r' into the range |0, N - 1]. This is the effect 
of the term NH(t' - t), which will be explicitly required in computations. How¬ 
ever, interpreting £(t) in its extended or cyclic sense allows us to omit the term 
NH( t ' — t ) from the written expressions. 


EXAMPLES OF DISCRETE FOURIER TRANSFORMS 1 


Certain short, discrete transform pairs are often needed. A small stock of trans¬ 
form pairs can be helpful for checking and is recommended when studying new 
algorithms and transforms. Here is a reference list for the DFT. 

N = 2: {1 0} D !{1 1} 

{ 11 } D \{2 0 } 

{ 01 } 3 \{\ - 1 } 

{1 -1| Dj(02). 


1 As there is little risk of confusion, we may use the sign D to stand for "has DFT." Thus Eq. (1) could 
be written /(t) d f(v) and Eq. (2) could be written F(e) c /(r), where c means "has inverse DFT." 
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RECIPROCAL PROPERTY 


Just as the Fourier transformation applied twice in succession, with alternating 
sign of i, gives back the original function, so there is a corresponding property for 
the discrete Fourier transform. But owing to the use of a scaling factor N to make 
the index v integral, the discrete transform is not strictly reciprocal, even allow¬ 
ing for the sign of /. Thus 


N 


-i 


N - 1 iV - I 

S N “‘ 2 ' 2 ” [K/Ny 


T = 0 




If the DFT is applied twice in succession without changing the sign of /, we 
will get N ’/(-r) on the right-hand side. Expressing this differently, if 

f(r) => f», 

then F(v) D N~ l f(— r). 

This property and other properties, and several theorems will not be derived, 
but are readily verifiable by numerical trial. Instead, emphasis will be placed on in¬ 
terpreting and illustrating them and presenting them in a form suitable for reference. 


ODDNESS AND EVENNESS 
By definition, /(r) is even if 

f(~r) = /(r) 


and odd if 


/(-r) = -/(r). 
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Fig. 11.5 Even and odd sequences shown cyclically. 


Figure 11.5 illustrates the following odd and even sequences of 16 elements, where 
t runs from 0 to 15. 

Even: {5 432 1000 0000 123 4}. 

Odd: {0876 5 432 0 -2 -3 -4 -5 -6 -7 -8}. 

In these examples, the elements have been grouped in fours to help display the 
nature of the symmetry. Even and odd sequences of four elements are as follows: 

Even: {a be b). 

Odd: {0bQ-b}. 

Clearly the rules for extending the range of r to negative integers are required 
here, in particular the special case 

/(-t) =/(N - r). 

A similar relation holds for F( v), 

F{-v) = F(N - v). 


EXAMPLES WITH SPECIAL SYMMETRY 

Symmetry rules with respect to oddness and evenness assume the same form for 
the discrete transform as given in Chapter 2 for the continuous transform. 

real D hermitian 
imaginary 7) antihermitian 
real and even D real and even 
real and odd D imaginary and odd 
imaginary and even D imaginary and even 
imaginary and odd D real and odd 
even D even 
odd D odd 
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The following examples illustrate these results, which are of major importance 
in practical computing 

{1 2 3 4} D ]{10 -2 + 21 -2 -2 - 2»} 

/{I 2 3 4} D *{10/ -2 - 2; -2 2 - 2/} 

{1 0 0 0} D \{l 1 1 1} 

{0 10-1)3 1{0 -2/ 0 2/} 
i{4 2 1 2)D ii{9 3 1 3} 
i{0 10-ljD {{0 2 0 -2} 

{1 + 4 i 21 i 2 /} D +9; 1+3/ 1 + / 1 + 3/} 

{0 1 + i 0 -1 - /} D ]{0 2 - 2; 0 -2 - 2/}. 


COMPLEX CONJUGATES 

The discrete transform of the conjugate is the conjugate of the transform, reversed: 

/*(t) ^ 

By "reversal," we mean changing the sign of the independent variable. 


REVERSAL PROPERTY 

If the sign of r is changed, that is, if /(t) is reflected in the line t = 0, the sign of 
v is changed: 

/(-r) D F(- v). 

It is worth noting that this operation on /(t) is also produced by reflection in the 
line r = \N. 


ADDITION THEOREM 

f\(r) + / 2 (t) p /-'i(e) + f 2 (^). 


Example: 


If 

{2 0 

and 

{0 1 

then 

{2 1 

■ 



0 0 | 3 1(2 2 2 2 } 

0 0} D i{l -/ -1 /}, 

0 0} 3 |{3 2 - / 1 2 + /}. 


SHIFT THEOREM 


/(t -T)d e ,2nT{r/X) F(^). 



CHaptfr 11: The Discrete Fourier Transform and the FFT 


269 


Example: 

{1 000 } D 1{1 1 1 1 } 

{010 0} D {{1 (-if (-if) 

{0 010} D\{\ (-if (-if (-if) 

{0 0 0 1} D{{1 (-if (-if (-if). 

Sometimes a shift in the frequency domain is required; one version of what could 
be called the inverse shift theorem is 

t*' 2 " WN>r /( T ) D F(v - e 0 ). 


CONVOLUTION THEOREM 

The cyclic convolution of two sequences {/,(t)} and {/ 2 (t)} was defined by 

/i( T ) * fz ( r ) = 2) /i(t')/ 2 (t - r). 

t' —0 

Remember that f 2 { ■ ) has to be understood in its extended cyclic sense. To em¬ 
phasize the distinction between this discrete operation and the convolution inte¬ 
gral, we may use the term convolution sum, but where there is no risk of confu¬ 
sion, it may be called simply the convolution of the sequences {/J and {/ 2 }. The 
theorem is 

/,(r) * / 2 (r) D NF,(e)F 2 (e). 

Example: 

Let {1 1 0 0} D {{2 1 - / 0 I + /}. 

Then {1 1 0 0} * {1 1 0 0( = {1 2 1 0} D {{4 -2/ 0 2/}. 

Also, {1 1 0 0} * {0 0 2 2} = {2 0 2 4} D ]{8 4/ 0 -4/}. 


PRODUCT THEOREM 

The inverse of the convolution theorem, which applies to products in the t do¬ 
main, or convolution in the v domain, is 

v m 0 


Example: 


/ i =/2 = /,/ 2 = {1100}3!{2 1-/0 1+/}. 
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CROSS-CORRELATION 


N- 1 


2/i( t ')/2(t' + t) O NF,(v)F 2 (-v). 

t' = 0 


AUTOCORRELATION 


N -1 


2/.(t')/,(t' + r) D N|F,(i/)| 2 . 

T=0 


Example: 


{1 1 0 0 } * {1 1 0 0 } = {2 1 0 1 } 

D 1{4 2 0 2}. 


SUM OF SEQUENCE 


N -1 


2 /(t) - NF(0). 


Example: 

{1050} D {1.5 -1 1.5 -1). 

We see that 2/ = 6, F(0) = 1.5, N — 4, and NF(0) = 6. If we follow the practice 
of writing N 1 as a first factor of F(r), the theorem means that the sum of the se¬ 
quence is equal to the first term after the opening brace on the right-hand side. 


FIRST VALUE 


This is the inverse of the preceding: 

m = s rw- 

i-0 


Example: 


m -1 


and 


2F - 1.5 - 1 + 1.5 - 1 = 1. 
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We see that the mean of a sequence equals the first value of its DFT, but con¬ 
versely the first value of the sequence equals the sum of the DFT. 

|—mean equals A — 

{7^} D 


L 


{ A_^} 
first value a equals sum-^ 


GENERALIZED PARSEVAL-RAYLEIGH THEOREM 

2 i/(t)i 2 = n 2 |f»i 2 - 

T-0 «'-0 

Example: 

{1 1 0 0 } D \{2 1 - / 0 1 + /}. 

We see that £/ 2 = 2 and that NXF 2 = 4 x 0.5 = 2. 


PACKING THEOREM 

The packing operator Pack, packs a given N-mcmber sequence /(r) with trailing 
zeros so as to increase the number of elements to KN 

Pack K {/(r)} « {g(r)}, 

|/W 0*r«N-l 

M ' \o N^t^KN- 1. 

Pack, {1 2 3 4} = {1 2 3 4 0 0 0 0}. 

This theorem is 


where 

Thus 


where 



Pack, {/(r)} D G(r), 
v = 0,K,2K, - KN - K. 


The intermediate values of G(e), not given by this relation, can be determined by 
sinc-function interpolation between the known values [e.g., by midpoint inter¬ 
polation (p. 225) when K = 2], but for a better method, see Problem 11.8. 
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SIMILARITY THEOREM 


To have an analogy with expansion or contraction of the scale of continuous time, 
we must supply sufficient zero elements, either at the end, as with packing, so 
that the sequence may expand, or between elements, so that there is room for con¬ 
traction. The operation of inserting zeros between elements so as to increase the 
total number of elements by a factor K will be denoted by the stretch operator 
Stretch*. 


where 


Stretch* {/(r)} = {tf(r)}, 

, , ff(r/K) t =0,K,2K .(N - 1)K 

v t ) - < 

If) otherwise. 


Example: 


Stretch, {1 2 3 4} = {1 0 2 0 3 0 4 0}. 


The theorem is, if {^} D {G}, 


/ 


C (*0 = < 


>) 

fa-N) 


v = Q .N - 1 

v = N,...,2N - 1 


1C - IN) 


v — (K — 1 )N . KN - 1- 


Thus, stretching by a factor K in the t domain results in K-fold repetition of F(v) 
in the v domain; the frequency scale is not compressed by a factor K. 


EXAMPLES USING MATLAB 

The DFT is readily evaluated using MATLAB K , a high-level language that can ex¬ 
ecute operations on arrays from the keyboard and therefore is particularly adapted 
to displaying numerical results as the sequence of complex values constituting 
the DFT of a given sequence. For example, to obtain the DFT of the sequence 
{1 1 1 1 0 0 0 0} just type 

fft([l 1 1 10000]). 

press the return key, and the following is displayed: 

4.0000 1.0000-2.4142/ 0 1.0000-0.4142/ 0 1.0000+0.4142/ 0 1.0000+2.4142/ 
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The MATLAB definition of the operator f ft( ) does not include division by 
N, consequently the first value 4.0000 shows the sum of the input values rather 
than their mean. The DFT definition in this chapter includes division by N and 
so ensures that first value of the DFT sequence is the mean of the input values, 
as has long been established for the first coefficient a 0 of a Fourier series. Further 
minor differences vis-a-vis the DFT are seen from the definitions. Calling the in¬ 
put sequence y(m), 1 n N, the computed discrete transform values are de¬ 
fined by 


X(k) = 2 x{n)e- i2 * ik -'*‘-' VK , 

n- 1 

while the slightly different inverse summation that yields the original y(h) is 

.Y(«) = ,x " ivN , 

N k=] 

where the suppressed factor 2 l/N now raises its head. The inverse summation is 
performed by ifft( ). 

The variable n is the serial number of the input samples For example, the N 
elements of a time series are to be indexed so that the first value is at n = 1 and 
the last value is at n = N. The connection between the variable k and frequency 
can be explained as follows. If the unit of n is one second, then when k =£ N/2 + 1 
the frequency in hertz is (k — 1 )/N. This is not the standard 3 use of k in digital 
signal processing, where k is directly proportional to frequency (for k N/2); still, 
the leftmost value of k in the display corresponds to zero frequency, just what one 
is accustomed to. 

From continuous-variable theory it is known that applying the Fourier trans¬ 
form to a function/(f) twice in succession produces /(—/), the reverse of the orig¬ 
inal function. To test MATLAB against expectation, type 

fft(fft([l 1 1 1 0000])) 

and obtain 

8.0000 0.0000 + 0 . 0000 / 0 + 0 . 0000 / - 0.0000 + 0 . 0000 /, 

0 8.0000 - 0 . 0000 / 8.0000 - 0 . 0000 / 8.0000 - 0 . 0000 / 


2 In practical computing as distinct from algebraic definition, where consistency with previous prac¬ 
tice is advised, it is wasteful to include the factor l/N in the evaluation of either the direct or inverse 
summation. The stage following transformation usually calls for an additional multiplier for normal¬ 
ization to unit area or to unity at the origin or for adjusting the height of graphics output. Combina¬ 
tions of numerical factors can be reduced to a single multiplication at the final stage. 

3 It is customary to expect that a, cos 2-rrkf represents the Lth harmonic and in particular that k - 0 
refers to the d.c. component at zero frequency, while k = 1 refers to the first harmonic (of unit fre¬ 
quency). With MATLAB, k = 1 refers to the d.c. component and k = 2 refers to the first harmonic. 
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which for case of inspection may be rewritten 

8{1 0 0 0 0 1 1 1}. 

Apart from the factor 8 arising from the definitions, this is in fact the correct re¬ 
verse of the original, under the same rules as for the OFT (see Fig. 11.3ft). The left¬ 
most element of n discrete samples of /(f) corresponds to t = 0, the next element 
to the right corresponds to f = Af, while the rightmost element corresponds to 
t = -A t. 

Asymmetrical function of t, say n(f/5), sampled at intervals Af = 1, would 
be represented by {1 1 1 0 0 0 1 I}. The DFT should be purely real since the given 
sequence is symmetrical about n = 1. Tvping 

fft([l 1 1 000 1 1]) 

yields 

{5 2.4142 -1 0.4142 -1 2.4142} 

which, we see, turns out to be purely real, in agreement with expectation for a 
symmetrical real input. 

Exercise a. Representation of an even function. An even function of t has 
the property that /(— t) = f(t) but a discrete sample set .y(h), where n runs from 
1 to 8, does not allow for negative indices; therefore we cannot say that a sample 
set is even when ,v(—;;) = x(n). Satisfy yourself empirically that the sequence 
{42 1 0001 2} is, however, suitable for representing samples of an even function 
on the grounds that its discrete Fourier transform is purely real. t> 

Exercise ft. Replacement rule for indices that are zero or negative. Verify 
that the sequence {432 1 0123} is suitable for representing the even function 
4A(f/3.5) at unit intervals of / if the following replacement is made where n is 
nonpositive: .v(-/i) => .v(8 — >i). Check that this replacement also accounts for the 
result of the previous exercise. t> 


Exercise c. Applying the index replacement rule. Consider a sequence 
{1 2344321 0}, which consists of samples taken at one second intervals of a 
function/(f). Note that the values are samples of A (f — 4)/4] (which is not an 
even function) taken at f = 1,2, ... 9. First show that applying fft( ) to the 
given sequence produces imaginary parts that are zero and that the result cannot 
therefore be even a rough approximation to the Fourier transform of A[(f — 4)/4], 
which will be complex. What then is an even function of f that the given sequence 
could refer to? t> 

Exercise d. Odd functions. Verify that the sequence {03 21 0 —1 —2 —3} is 
suitable for representing an odd function by showing empirically that operating 
on it with fft( ) produces a purely imaginary discrete transform. Check that 
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the sampled function could be the odd function A(f/4) sgn t. Would another pos¬ 
sibility be A(f/4) sgn t + sin vt? > 

Exercise e. Zero packing. Let x 4 (n) = {111 l},.r K (n) = {1 1110000}, and 
x ]f ,(n) = {1 11100000000000 0}, all generated by sampling n[(f — 2.5)/4] at 
intervals A/ = 1. Apply fft( ) to all three, compare the three results, and rec¬ 
oncile with the Fourier transform F(s) = 4 exp (-/37rs) sine 4s. > 


THE FAST FOURIER TRANSFORM 

In 1965 a method of computing discrete Fourier transforms suddenly became 
widely known (Cooley and Tukey, 1965) and revolutionized many fields where 
onerous computing was an impediment to progress. Good sources of historical 
information are the IEEE Transactions on Audio and Electroacoustics, vol. AU-2, 
June 1967 and Bergland (1969). The name Discrete Fourier Transform was intro¬ 
duced in Good (1951). 

There are various ways of understanding this fast Fourier transform (FFT). 
One way, which will appeal to certain people, is in terms of factorization of the 
transform matrix. From the definition, we can write the DFT relation (for N = 8) 
in the form of a matrix product, 

111 1 1 1 1 1 

1 w w 2 w 3 w 4 W s W f ’ w 7 

1 w 2 w 4 w 6 w 8 w ,n w 12 w 14 

1 w 3 w 8 w 4 w ’ 2 w n w ' 8 w 21 

1 w 4 w 8 w 12 w 16 w 20 w 24 w 28 x 

1 W s W 10 W 15 W 20 W 25 W 30 w 35 

1 w 6 w 12 w ,H w 24 w 30 w 36 w 42 

1 w 7 w ' 4 w 21 w 28 w 33 w 42 w 49 _ 

where W = exp ( — i2ir/N). The quantity W is an Nth root of unity, since 
W N = exp (-Htt) = 1. It may be thought of as a complex number whose modu¬ 
lus is unity and whose phase is —(1/N) turns. 

F(0) 100 0 1 0 0 0 101 0 000 0 “ 

F(l) 0 10 0 0 W 0 0 0 1 0 W 2 0 0 0 0 

F(2) 0 0 100 0 W 2 0 10W 4 0 000 0 

F(3) 0 0 0 1 0 0 0 W 3 0 1 0 W 8 0 0 0 0 

F(4) 1 0 0 0 W 4 0 0 0 X 0 0 0 0 1 0 1 0 

F(5) 0 1000 W" 0 0 000 0 010 W 2 

F(6) 0 0 1 0 0 0 W (> 0 0 0 0 0 1 0 W 4 0 

F(7)J [o 0 0 1 0 0 0 W 7 J [0 0 0 0 0 1 0 W 6 _ 


F(0) 

F(l) 

F(2) 

F(3) 

F(4) 

F( 5) 

F(6) 

_f(7)J _ 
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This factorization leaves only two nonzero elements in each row. In (1) there 
are N 2 multiplications but there are only 2N multiplications per factor if we use 
(2), and the number of factors M is given by 2 M = N if we do not count the first 
factor, which merely represents a rearrangement. Thus the multiplications total 
2N log 2 N. Examination of the factors shows that many of the multiplications are 
trivial, and therefore to calculate the precise tune saving will require careful at¬ 
tention to details. Nevertheless, we are better off by a factor of the order of 
N/log 2 N, which becomes very important for the large values of N which arise 
with very long data trains or with digitized two-dimensional images such as pho¬ 
tographs, for example. 

Here is another method of understanding the fast Fourier transform. A se¬ 
quence of N elements may be divided into two shorter sequences of N/2 ele¬ 
ments each by placing the even-numbered elements into the first sequence and 
the odd-numbered ones into the second. For example, {8 7654321} can be split 
into {8 6 4 2} and {7531}. Each of these possesses a DFT. From these two DFT's 
how could one obtain the DFT of the longer sequence? The answer is obtained 
by writing 

{8 7654321} = {8 060402 0} + {0 7050301}. 

We see that the desired DFT can be obtained by using the stretching and shift the¬ 
orems. From the stretching theorem we know that if 

{8 6 4 2} D {ABCD}, 

then {80604020} D \{A BCD A BCD}, (3) 

a phenomenon that may be familiar from Fourier series coefficients for periodic 
functions. 

Likewise, if 


{7 5 31} D {PQRS}, 

then {7 0 5 0 3 0 1 0} D |{P Q R S P Q R S}. 

Now we apply the shift theorem to find that 

{0 70 50 301} D \{P WQ W 2 R W 3 S W 4 P W 5 Q W 6 R W 7 S}. (4) 

Multiplication by W means rotation by one Nth of a revolution in the complex 
plane, so the effect of the shift is to apply a phase delay that increases progres- 
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f(r) *• 2F(v) 



sively along the sequence of elements {P Q R S P Q R S}. Adding (3) and (4) gives 
the DFT of the long sequence. Thus the transformation with N = 8 has been bro¬ 
ken down into two transformations with N ~ 4, which potentially represents a 
50 percent time saving, since the number of multiplications in a DFT performed 
according to (1) goes as N 2 . To see how this breaking down can be taken even fur¬ 
ther, we refer to Fig. 11.6. Starting with the given sequence on the left, we re¬ 
arrange it into the two short sequences {8 6 4 2} and {7531} that form the inputs 
to two transformers with N = 4 whose outputs are {A BC D} and {P Q RS} r re¬ 
spectively. The unbroken flow lines show that A, B, C, and D are transferred to 
the output nodes to deliver {A B C D A B C D}. The broken flow lines are tagged 
with factors that cause the delivery of P, WQ, W 2 R, etc., as in (4) to the same out¬ 
put nodes, where addition takes place. Figure 11.7 now shows a further reduc¬ 
tion of each four-element transformer to two two-element transformers, and Fig. 
11.8 shows the full reduction to multiplications and additions. 

Finally, the steps may be summarized as follows. First, we rearrange the given 
sequence into {8 4 6 2 7 3 5 1}, an operation corresponding exactly to multiplica- 



Fig. 11 .7 Reduction to four two-element DFTs. 
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Fig. 11.8 Reduction of eight-element DFT to 3 x 16 multiplications and 3x8 ad¬ 
ditions. In the foregoing three figures, multiplication by unity is shown 
by a full line and the broken lines are associated with the factors shown, 
(Adapted from Cochran et al., 1967.) 


tion by the first square matrix of (2) and sometimes loosely referred to as bit re¬ 
versal. Then eight new numbers are calculated as linear combinations of various 
pairs of the rearranged data, exactly as indicated by the second square matrix of 
(2). These numbers are the outputs from the left-hand column of adders in Fig. 11.8. 
There are two more similar stages, making a total of three such operations in all 
(or M, in general, where 2 V ‘ — N). Of course, not all the 48 multiplications are sig¬ 
nificant. There are 32 multiplications by unity and 7 multiplications by W 4 , which 
is simply a sign reversal. In addition, W : and W 6 are rather simple to handle. 

We thus sec that Fig. 11.8 is an intimate representation of the four matrix mul¬ 
tiplications of (2), and the considerations leading to the construction of Fig. 11.8 
could be the basis of a step-by-step discovery of the factors that were presented 
in (2) without derivation. 

If the number of elements cannot be halved indefinitely (i.e., N is not ex¬ 
pressible as 2 W ), a fast algorithm may still be tailormade to suit. The final reduc¬ 
tion might then incorporate three-element transformers if, for example, N was di¬ 
visible by 3. Such algorithms are not quite as fast. 


PRACTICAL CONSIDERATIONS 

Many practical considerations have been incorporated into the programs avail¬ 
able for performing the fast Fourier transform. For some applications, speed is an 
overriding consideration; for others, convenience. If N is not a power of 2, con¬ 
venience says pack the data with zeros; speed says choose a modified program 
taking advantage of such factors as N possesses. Some users never require com¬ 
plex output; others do, but not in the form of real and imaginary parts. Some re- 
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quire two and three dimensions. Some normally have to segment their data be¬ 
cause N exceeds the capacity of their computer. Questions of this kind, though 
important, can be studied through the literature using the sources given above or 
by examination of existing programs. Examination of documentation can be par¬ 
ticularly important, because some software packages do not implement the DFT 
at all but rather some modification possessing more or less convenience. 

Here we shall look into the very common situation where a data string of, 
say, 60 elements is to be transformed by a general-purpose program which allows 
a choice of 64, 128, or other power of 2 for N. Adding four zeros will fit the data 
to the program. Will it make a difference whether the zeros trail, precede, or are 
placed in twos at start and finish? From Fig. 11.4 and remembering the shift the¬ 
orem, we see that |F(i')| will be unaffected but that the effective shifts of origin 
will introduce phase differences. If phase is important, as it might be if the data 
string has a natural origin, the shift theorem will supply the appropriate phase 
correction factor. 

Will it make a difference if 68 trailing zeros are added and the N = 128 pro¬ 
gram is used? Surprisingly to some, the answer can be yes. To understand this, 
consider the extended sense in which /(r) and F{v) are regarded as periodic with 
period N. 

Let u(f) be a function of the continuous variable t, which at integral values of 
t in the range just embracing 0 to N — 1 agrees with /(r) and is zero outside, as 
in Fig. 11.9fl. Then, i’(f)III(f) is a string of impulses (Fig. 11%) that contains pre¬ 
cisely the same information as /(r) but does not have the property of repeating 





Fig. 11.9 A function (a) and its discrete representation (b) on a cyclic basis. Parts 
(c) and (d) show two pulse waveforms, as functions of continuous time, 
that are equivalent to the discrete representation. 
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with period N. Periodic character is, however, exhibited by the expression 

p{t) = [i*0HI(0] * N 'NI(f/N), 

which is in strict analogy with /(r). Because of the convention of representing im¬ 
pulses by arrows with length equal to the strength of the impulse, Fig. 11.9c would 
become a precise representation of /(r) if the abscissa label were changed to r and 
the arrowheads were changed to blobs. 

If the Fourier transform of v(t) is S(/), then we may use the convolution the¬ 
orem and knowledge that the shah function III(-) transforms into itself to obtain 

P(f) = [SCO * I1I(/)]III(N/). 

This expression has the same exact correspondence with the DFT F(i>) that p(f) 
has with /(t), provided that we use the relation / = v/N to translate between / 
and v. The factor N 1 in (3) is accounted for. Thus the rather simple algebra de¬ 
veloped in Chapter 10 includes as a special case discrete situations that appear at 
first to be outside the scope of the integral transform. 

If we now replicate the same data string r?(/)IIl(f) with a period 2 N, we have 
[p(f)III(f)] * (2 N) ‘III(f/2N) and the transform becomes 

[S{f) * III(/)]I1I(2N/). 

The only difference is that the same expression S(f) * III(/) is sampled twice as 
closely in frequency. How, then, could an apparently improved sampling be per¬ 
ceived as different? The answer is that S(f) may be oscillatory and indeed nor¬ 
mally will be, unless /(r) is free from large jumps such as those that often occur 
at the beginning and end of data strings. Of course, because of the cyclic charac¬ 
ter of /(t), a large initial value/( 0) will not count as a large jump if the final value 
f(N - 1) is approximately equal. But if such a data string of 64 elements were ex¬ 
tended to 128 elements by the addition of trailing zeros, there would be jumps. 
Rough structure would then appear in F(v). Likewise, if four consecutive elements 
of the relatively smooth 64-element string were put to zero, oscillations would ap¬ 
pear in F(v). This suggests that adding zeros might not always be the best way 
to pack a data string out to 64 elements. A result more in keeping with expecta¬ 
tion might result from packing with dummy values having more plausibility as 
data than zeros would have. 


IS THE DISCRETE FOURIER TRANSFORM CORRECT? 

While the theory of the DFT is precise and self-consistent and exactly describes 
the manipulations performed on actual data samples when a Fourier transform 
is to be computed, the question remains to what degree the DFT approximates 
the Fourier transform of the function underlying the data samples. Clearly, the 
DFT can be only an approximation, since it provides only for a finite set of dis¬ 
crete frequencies But will these discrete values themselves be correct? It is easy 
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to show simple cases where they are not. Discussion of the question can be based 
on the sampling theorem and the phenomenon of aliasing. If the initial samples 
are not sufficiently closely spaced to represent high-frequency components pres¬ 
ent in the underlying function, then both the DFT values and a smooth curve 
passing through them will be falsified by aliasing. If the underlying function is 
known, then the error associated with a given choice of sampling interval is cal¬ 
culable. If one takes the operational viewpoint that the measured data samples 
may be the only knowledge we have, then avoidance of error will depend on ex¬ 
perimental factors such as prior knowledge or experience. For example, a run with 
twice the number of samples in the same time could confirm the presence or ab¬ 
sence of higher frequencies. 

A further important source of error in the DFT lies in the truncation of data 
strings. It is, of course, unavoidable that truncation of a function will result in an 
erroneous Fourier transform (the result obtained will be the convolution of the 
true Fourier transform with a certain sine function), and so truncation error is not 
specific to the DFT. However, the error committed will be different. To see this, 
imagine a case where the sampling interval is quite fine enough to cope with the 
highest frequencies present in the data, so that there is no aliasing error. Now 
truncate the data. The effect on the DFT will be to convolve it with samples of the 
sine function corresponding to the width of the rectangle-function factor describ¬ 
ing the truncation. But this time we are convolving with an entity such as Q(f) 
in Fig. 11.1. In addition to the smoothing out we now have the prospect of the left 
and right islands of Q(f) leaking into the central island. The truncation effect thus 
comprises both smoothing error, or reduction of fine detail in the DFT, and leak¬ 
age error. Leakage error may be reduced, at the expense of increased smoothing 
error, by use of a tapered truncation factor in place of the rectangle-function fac¬ 
tor. The best compromise must depend on the case; leakage error tends to falsify 
the "higher" frequencies (r in the neighborhood of N/2), whereas smoothing er¬ 
ror is distributed differently. 


APPLICATIONS OF THE FFT 

In some subjects, such as x-ray diffraction and radio interferometry, the observa¬ 
tional data require Fourier transformation in order to be presented in customary 
ways, such as a molecular shape, a crystal structure, or a brightness distribution 
map of a celestial source. In these fields the introduction of the FFT merely speeds 
up what was already practiced 

In other applications, one takes the Fourier transform in order to perform 
some operation on it and then retransforms. For example, if we had a photo¬ 
graphic enlargement that was particularly grainy (i.e., finely speckled because of 
the grain structure within the photographic emulsion) we might subject the pho¬ 
tograph to two-dimensional low-pass filtering. First we would digitize it into a 
two-dimensional array of numbers, although it might already be in digitized form 
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Fig. 11.10 Flow diagram for convolving. 


(c.g., if it had been received by radio telemetry from a space probe). Then we 
would take the two-dimensional DFT and remove or reduce the higher spatial 
frequencies by multiplication with a suitable low-pass transfer function. Finally, 
we would invert the DFT. Of course this would be equivalent to convolving the 
digitized photograph with the appropriate point-source response (inverse DFT of 
the transfer function). For desk calculation one convolution may be more attrac¬ 
tive than two DFT's and one set of multiplications. But with the large quantities 
of data that a photograph normally contains, a larger computer would be required, 
and it would then be found that the DFT route is quicker if the FFT is used. The 
reason is that, if there are N elements in the array of data, the number of multi¬ 
plications required is of the order of N 2 , whereas as we have seen, the FFT re¬ 
quires far fewer if N is large. 

Thus convolution in general, including cross correlation and autocorrelation, 
is now best performed by taking the two DFT's, multiplying, and inverting the 
DFT. Some special considerations arise. Consider first a case where (Fig. 11.10) 
the two inputs / and % to be convolved have the same number of elements, as 
happens with autocorrelation. The output function will have twice as many ele¬ 
ments as the input functions. So if one simply multiplies F and G term by term 
and retransforms, the output will be only half the correct length. The result of this 
procedure can be visualized in terms of cyclic convolution as in the example of 
autocorrelation shown in Fig. 11.4. What will happen is that the output sequence 
will close around the circle and overlap itself. Clearly this can be avoided, as in 
the figure, by packing the given functions with zeros; enough to double the length 
of the given sequences will suffice. Figure 11.11 brings out these practical points 
in a way that is glossed over in Fig. 11.9. 


TIMING DIAGRAMS 

Much literature devoted to fast algorithms has relied on numerical evaluation of 
computational complexity, usually in the form of counts of multiplications and 
additions, counts that are easily obtained by inserting a program line that incre¬ 
ments a counter by one at each point in the program where the operation to be 
counted occurs. Such counts, as a function of N in the case of Fourier transforms, 
have frequently been published and compared with the results for predecessor 
programs. Programs that succeed in reducing the number of operation counts are 
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Fig. 11.11 Convolution of two four-element sequences performed by using the 
DFT. 


then said to be faster. However, timing is the fundamental criterion for speed and 
has proved a convenient tool for investigating the time-consuming components 
such as permutation, pretabulation of sines and cosines, and other steps, as shown 
in Fig. 12.5. 

MATLAB facilitates timing of program segments by insertion of tic, which 
starts a timer, and toe, which gives elapsed time. Use of this tool allows overall 
running time to be broken down into components to reveal steps where time is 
wasted. In the past, users of central computers found timing to be interfered with 
by time-sharing between users, and later even stand-alone computers found ways 
to perform clean-up tasks while ostensibly working on the owner's program. Such 
interference with timing, if present, can be revealed by rerunning the program 
and noting that the elapsed time is reported differently. Serious programmers can 
attempt to work around this unwanted behavior by plotting elapsed time against 
some parameter, such as N, where a smooth plot is expected, and superposing 
numbers of reruns to help identify spurious contributions to elapsed time. 


WHEN N IS NOT A POWER OF 2 

A data sequence of N = 365 elements is not directly amenable to successive halv¬ 
ings, but since 365 = 5 x 73 there is still, in theory, an advantage to be extracted. 
In practice, special base-3, base-5, base-7, base-11, and base-13 algorithms are avail- 
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able (see Nussbaumer, 1982, and Elliott and Kao, 1982, for algorithms due to 
S. Winograd), but no base-73 algorithm is to be expected. With 365 data values 
the straightforward procedure is to extend the sequence to 512 with appended ze¬ 
ros. Of course, the resulting 512 transform values will not refer to frequencies that 
are harmonics of one cycle per year. However, if needed, the 365 complex values 
will be delivered by the MATLAB fft ( ) operator. 


TWO-DIMENSIONAL DATA 

Let us compare the standard form of the two-dimensional Fourier transform 
(Chapter 13) 

F(u,v) = |" |' a * ux + v * ) dxdy 

with the two-dimensional discrete Fourier transform 

m -1 N i 

F{ti.v) = M ’/ST 1 2 2/( ,r ' T)e~ a « tur,M *" /N ). 

<» =0 T-0 

The integers <r and r may be connected with the (.v,i/)-planc as follows. If the sam¬ 
pling intervals are X and Y, and A min and y min * ire fhe minimum values of .t and 
y to be considered, then 

mm 

fr = ~x~ 

y .Vnnn 

T = —7— 

Since M - 1 and N — 1 are the largest values reached by a and t, respectively, it 
follows that 

'max ■'"min "h (M 1)X 
]/m.n }/min T (A/ 1 )X. 

The spatial frequency integers /x and v are such that ix/N and vjhA are spatial fre¬ 
quencies measured in cycles per sampling interval of x and y and /x/NX and v/NY 
are spatial frequencies measured in cycles per unit of v and y. This discussion pic¬ 
tures f{( t,t) as a function that possesses values in between its discrete samples 
but presumes those values to be unavailable. That situation often arises, which is 
why a connection with the integral transform has been established here. But/we 
also understand that it is not necessary to regard f(cr, r) as other than a function 
of integer pairs only and that /x and v need not be regarded as frequencies. In fact, 
as previously noted in one dimension, great care has to be taken in interpreting 
[x and i> as frequencies. 

Whereas the integral transform covers positive and negative areas of the (>,i/)- 
plane, the discrete transform does not require negative values of rr and r. Con- 
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Fig. 11.12 (a) When f(x,y) is formed into an M x N array with positive subscripts 

starting from zero, it appears on the (rr,r)-plane dissected as shown; 

(b) a surround of zeros in the (.v,y)-plane (shown shaded) is not entered 
as a surround in the (<r,r) plane. 


sequently, a simple object in the (.v,y)-plane as in Fig. 11.12/? becomes carved up 
in a strange way on the (tr,r)-plane when the shifts of origin are made. It is very 
helpful to have the topology of this figure in mind when handling two- 
dimensional data. For example, the idea of surrounding the object with a guard 
zone of zeros, shown crosshatched, a trivial move in the (.v,i/)-plane, not requir¬ 
ing reassignment of existing data, calls for a rather tricky maneuver on the (oyr) 
matrix as shown in Fig. 11.12b. 

If, by oversight or design, the <r and t axes are not taken to coincide with the 
nominal axes x and i/, then the transform obtained will be affected. For example, 
an object symmetrical with respect to the .v and 1 / axes will hav e a real-valued 
transform, but complex values will result if the (t and r axes are shifted. If, not 
realizing this, one reads out the real transform values only, they will be wrong. 
However, if one reads out the complex values they will differ only in a trivial way 
from the nominal transform. The modulus will be correct and the phase will ad¬ 
vance linearly with a and r in the way controlled by the shift theorem. 


POWER SPECTRA 

In many situations where transform phase is unimportant or unknowable, one 
could deal with F{v)\, but it is customary to deal with T(p)I 2 , which is equiva- 
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lent, and to refer to |F(e)| 2 as power spectrum. Values of |F(i/)| 2 may indeed 
represent a number of watts in some applications, but even where the physical 
significance is not power or where there is no physical significance at all, the term 
"power spectrum" is in common use. The term is also used in connection with 
the Fourier transform S(/) of a function of continuous time (pp. 120, 122), but 
there is a distinction. A power spectrum |S(/)| 2 would be measured in units of 
watts per hertz or something more complicated (such as ohm-watts per hertz as 
in Rayleigh's theorem on p. 206) but never in plain watts. 

At first sight it might seem unnecessary to give special computational atten¬ 
tion to the power spectrum, which is, after all, included within the larger concept 
of the (complex) Fourier transform. But, in fact, a great deal has been written un¬ 
der the heading of power spectra, where power spectra per se have not actually 
been of the essence. The literature referred to might equally well have been enti¬ 
tled spectra of random functions of time. The reason for the terminology is that 
random functions or noise waveforms present one of the important situations 
where phase loses meaning and the power spectrum becomes the natural entity 
to work with. 

Although the power spectrum has a wider range of application than just to 
random processes or to deterministic signals of random origin, these applications 
are nevertheless important. The power spectrum of a random process is quite of¬ 
ten defined as the Fourier transform of the autocovariance function of the process. 
(The autocovariance is what results when any d-c component is subtracted before 
autocorrelation is performed. But the distinction in terminology is not universally 
observed because it is commonly understood that any nonzero mean level is to 
be subtracted before calculating the autocorrelation, since the calculation is im¬ 
possible otherwise.) 

A definition of power spectrum in terms of autocorrelation (or autocovari¬ 
ance) seems indirect to many students but does permit the solution of problems 
involving random processes that are specified in the time domain by probabili¬ 
ties. When computation is required, however, one is never dealing with a random 
process but with an actual data string, possibly of random origin in some sense. 
(There may, in addition, be random errors of measurement.) 

The curious fact that makes computation of power spectra so interesting is 
this. Suppose one takes the DFT of a data string of N elements. To be concrete, let 
the N data values be the height of the sea surface at a certain point, taken at 10- 
second intervals. Naturally, the values of F„(r) ought to show in what frequency 
bands the wave power resides, but the precision will be limited, as will the reso¬ 
lution, because N is only finite. The values of pha F v (r) will not be zero, but can 
hardly be expected to contain anything of interest, and if they are abandoned, 
IFvli')! 2 will constitute our measurement of the power spectrum of the waves. If 
the state of the sea were to change, as it is always doing, that measurement would 
have to stand as the record of the sea spectrum at that epoch. But because of the 
finite value of N, the measurements are imperfect to a degree that is evidenced 
by irregular variation from one value of v to the next. To make a better measure¬ 
ment next time we might take data for four times as long, but how would we 
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know that the sea spectrum had not changed during the period of observation? 
The only way to tell from the data would be to divide the string into segments 
and make a judgment. Since this discussion has been cast in terms of sea waves, 
it is apparent that discussion of limits as N —»<x> would be inappropriate, but so 
would it be in the case of almost all kinds of data. One can conceive of exceptions 
such as determination of the power spectrum of the data string constituted by the 
consecutive digits of the decimal expansion of w, but in the physical world things 
change if an observation takes too long. Yet experience might suggest that quad¬ 
rupling N, thus staying far short of infinity, would double our precision or nearly 
so (i.e., the irregular variation might be halved). The strange thing is that the pre¬ 
cision is not improved at all by increasing N. Thus, even in theory, the idea of 
defining the power spectrum as a limit as N —*■ oe , does not work for data of ran¬ 
dom origin. 

One might suspect that the paradox disappears if the situation is viewed in 
the right way. Here is an explanation. In any frequency band, chosen in advance, 
the amount of power will indeed be measured with increased precision as N is 
increased. If N is quadrupled the DFT will supply four values in a fixed frequency 
band that previously contained only one. Even though these four values are no 
more precise than the previous one, the sum of the four, which represents the new 
measurement of the power in the band, will have greater precision. 

This correct view illuminates the procedure followed for computing power 
spectra of real data. The computed values of |F v (r , )| 2 will fall above and below 
some general trend with v, and the scatter may be reduced by averaging several 
adjacent values. If high precision is sought by averaging too many consecutive 
values, the precision is paid for bv loss of resolution in frequency, so a compro¬ 
mise must be arrived at by judgment based on experience with the character of 
the data. No unique advice can be offered by theory alone; that is why a variety 
of prescriptions can be found in the literature. In any case, the outcome is to 
smooth the sequence F(i >) 2 by taking running means over a certain number of 
values, that is, by discrete convolution in the power spectrum domain with some 
sequence of weights. 

Naturally several smoothing sequences have been proposed, but which is op¬ 
timum? The answer to this depends on the purpose of the analysis and on the 
character of the data. Although it is true that smoothing increases precision, there 
are a number of accompanying effects that may be undesirable. For example, if 
there is a narrow spectral feature that is of interest, then extra smoothing will give 
an erroneous low value for the central strength, an erroneous large value for the 
width and may introduce lobe structure on each side. There are cases w'here ab¬ 
solute strength measurement is important as in chemical spectral analysis per¬ 
formed by Fourier transform spectroscopy, other cases where it is important to 
separate close spectral features, and others where there is a heavy penalty for false 
detection of faint features. In the latter case one may suppress lobes that might 
be counted as real and accept the accompanying loss of resolution as represented 
by widening of the spectral feature. In another case one might accept lobe struc¬ 
ture in order to get a better strength measurement at a frequency peak. Even when 
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such costs and benefits are balanced to the user's satisfaction, the result will not 
necessarily be optimum for a new batch of data. It is apparent that selection of 
smoothing sequences goes beyond the realm of mathematical analysis to involve 
experience and judgment. 

In principle, smoothing in the power spectrum domain is achievable by mul¬ 
tiplying the autocorrelation function by a tapering factor. The term lag window for 
such a factor applied to the autocorrelation function was introduced by Black- 
mann and Tukey (1958). {Spectral xoindow is the Fourier transform of the lag win¬ 
dow.) However, when large amounts of data are involved, it is convenient to com¬ 
pute the autocorrelation by first performing the FFT, then forming the power 
spectrum and inverting the FFT. Once the power spectrum is formed, one might 
as well do the smoothing directly, especially as the sequence of weights is only 
likely to be short. 

In an earlier section it was shown that the DFT of a sampled function is not 
necessarily in close agreement with the Fourier transform of the function itself, 
especially where discontinuities in the function cause the spectrum to run out to 
high frequencies. A finite segment of data from a data stream will possess exactly 
the sharp start and finish that give rise to such disagreement. Therefore, some 
practitioners apply a tapering factor to the data to remove or reduce the terminal 
discontinuities. This is not the same thing as a lag window, but the general effect 
will be a "power spectrum" that is smooth. In general, the result will not be ex¬ 
pressible as a convolution between the raw power spectrum and a sequence of 
weights and therefore does not strictly represent the power in a frequency band. 
Whether this cost is less than the cost of providing for zeros must depend on the 
case. 

Clearly there is more to using the FFT than a prepackaged software program 
can provide. Because circumstances arc varied, and users differ according to their 
needs, use of the FFT is rather an art. As programs have become very fast and 
convenient, experimenting with one's own data and desiderata in order to gain 
relevant experience has become a valuable use for commercial programs. 
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PROBLEMS 


1. Discrete representation. A function (1 + t 2 )~ 1 Fl(f/10) is to be represented discretely for 
the purpose of computer experiments on the discrete Fourier transform using N = 16 
samples. Draw up a suitable table of values. 

t 01 2345678 9 1011 12 13 14 15 

/(') 

2. Cyclic convolution. Obtain the following cyclic convolution sums: 

{1 2 0 0} * {2 3 0 0}, {1 1 1 1} * {0 1 1 0}, and {1 0 0 1} * {0 1 0 0}. 

3. Discrete transforms. Obtain the DFT of the following sequences, checking the results 
by both the "sum of sequence" and "first-value" rules: 

{1 2 3 4} and {1234 0000}. 
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4. Convolution theorem. Obtain the cyclic convolutions 

{0 1 0 0} * {0 01 0} and {1 I 0 0} * {0 0 1 1} 
and verify the results by the convolution theorem. 

5. Two-dimensional convolution. Obtain the two-dimensional cyclic convolution sums 

{l o}"{u ?} “ nd {o 2}* * {o 0} 

and verify that the results are correct by mean of the two-dimensional convolution 
theorem. 


6. Two-dimensional DFT. Verify the following four DFT pairs in two dimensions and 
show that the fifth results from adding the four together 

jo ol l/l ll 

ii -piii 1) 

{:H (:-i 
{: Tin 1 
CiHO-l 

Jl ll 1 Jo ol 

{1 0} 

Enunciate two-dimensional sum and first-value theorems. Reconcile the pattern of mi¬ 
nuses in the transform with what might be expected from the two-dimensional shift 
theorem. Verify the two-dimensional Rayleigh-I’arseval theorem on the examples. 

7. Midpoint interpolation. A 16-element sequence whose DF1 is f(e) is extended to 32 
elements by the addition of 16 trailing zeros. The new DFT is C(e). By the packing the¬ 
orem we can obtain half the values of G(v) immediately; for example, G(0) = 
0.5F(0), G(2) = 0.5F(1), - . G(30) = 0.5F(15). Show that the intermediate values of C(i>) 
can be obtained by cyclic convolution of the known values with the midpoint interpo¬ 
lation sequence (p. 225), that is, that 

C(i/) = 0.5 ^ F - * " s) sine (* + |), i' = 1,3.31. 



8. Supplement to packing theorem. The preceding problem requires summing an infinite 
number of terms to obtain intermediate values of G(t/). Show that the sum reduces to a 
finite number of terms if the interpolating coefficients are modified as follows: 


G(v) = 0.5 


N 1 (v 

X 0 


K 


sin {7 t(k + {)] 
sin [ 7rlV~ '(k + ^)] 


v = 1,3, ...,2N - I, 
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where N is the number of elements in the original sequence before the hi trailing zeros 
are added. 


9. Two-dimensional autocorrelation. 

(a) Calculate the two-dimensional autocorrelation of the following data array (non- 
cyclically): 


r 



1 

2 

1 

l 


tT 


(F) Describe the nature of the symmetry possessed by the result. 

(c) Calculate the autocorrelation of the following one-dimensional sequences 
{1 1 1 2}, {1 1 0 1 2}, and {1 10 0 12}. Can you see a way of performing the two- 
dimensional autocorrelation by doing only one-dimensional autocorrelation? 


10. Comparison of DFT with FT. A function of the discrete variable r is defined by 
/(r) = exp (-r/4) for 1 s t €31, and for t = 0 the initial value /(0) = 0.5. Compute 
the DFT and compare with V(f) the FT of v(i) = exp (-t/4)H(t). t> 


11. Smoothing due to cosine-bell taper. If a function tf(.v) is gated by multiplication with 
Tl(x/X) and then tapered by multiplication by a cosine bell 0 5 + 0.5 cos (27r.v/X) 
its Fourier transform C(s) is smoothed as by convolution with X sine Xs 
[} 8 (s + X ') + iS(s) + - X ’)]. If an N-element sequence /(r) is similarly tapered 

so as to rise from zero at the beginning (r = 0) and fall to zero again at the end (t = N), 
show that the discrete transform F(v) will be modified by discrete convolution with the 
N-element sequence {[| —4 0 0 -}]}. The effect of this operation is to replace any 

value F(v) by -jF(v - 1) + }F(r) - |F(p + 1). From Problem 3.1/(p. 58) we know that 
serial products with {} } lead to smoothing. Would not the sequence {-} } -}} lead 
to sharpening? 


12. Index reversal in MATLAB. A row vector {1 2 3 4 5 6 7} is to be reversed to form a 
new row vector y(/i) = {1 765422}. Show how to perform the reversal operation in 
MATLAB. 


13. M-file for the discrete Hartley transform, (a) We would like to have a MATLAB 
function named dht that will operate on an 8 -element data sequence such as 
{12 3 4 5 6 7 8 }, for instance, and produce the known discrete Hartley transform. 

{4.5000 -1.7071 -1.0000 -1.7071 0.5000 -0.2929 0.0000}. 

The desired function program would read as follows 

f=[l 2 3 4 5 6 7 8 ]; 

N= 8; 
dht(f,N) 



292 


The Fourier Transform and Its Applications 


Write the M-file whose first line reads function y = dht (f ,N). 

(b) With the command dht available, compare the discrete Hartley transform results 
with some of the discrete Fourier transforms given in Chapter 11. Execute 
dht (dht (f, N) ) for inspection and then write an M-file idht that delivers the 
inverse discrete Hartley transform. t> 

14. Discrete FT versus expectation, (a) Verify that the sequence {123454321} consists 
of samples at unit spacing of the continuous triangle function 5 A(jt/ 5) whose Fourier 
transform is 25 sine 2 5s. (b) Obtain the DFTs of 

{1 2345432 1}, 

{0 0001 2345432 1 000 0}, 

{5 4 3 2100000000000123 4}, 

using the DFT definition sum or an available built-in routine such as £ft( ) in 
MATLAB. Which, if any, of the DFTs obtained meets the expectation of agreement with 
25 sine 2 5s? O 

15. DFT of binomial coefficients. Take {1 4 64 1} as an example of the binomial coeffi¬ 
cients B(n,x) = »!/(« — a)!.v! for n — 4 and fit a normal distribution A exp{— x*/2a 7 ). 
Match a to the root-mean-square departure of x from its mean (namely a - 1), and fix 
A by equating the area under the normal curve to the sum of the coefficients. Obtain 
the DFT of {6 41000000000001 4} and compare with the FT of A exp( -at 2 /2o- 2 ). 

16. Cyclic convolution sum. Given two sequences {I 7 21 35 35 21 7 1} and 
{1 5 9 5 -5 -9 -5 -1}, what is their cyclic convolution on a 12-element circular 
support? C> 

17. A timing experiment. Use the definition of T4, the nominal time for four multiplies, to 
see whether the time changes when an average is taken over many more or many fewer 
than N = 1000 tries. If possible, try two different computers, or different languages. 
Find out what can be deduced from such timing experiments. 

18. Sine interpolation. Midpoint interpolation by convolution with a sequence of samples 
of the sine function was described in Chapter 10. The same result is obtained by trun¬ 
cating {/} to N elements and taking the DFT of {/} to obtain {F}, which has N complex 
values. Now create a sequence {G} that retains these N values but has an additional N 
trailing zeros to extend the length to 2N elements, the zeros being used to extend the 
transform to higher frequencies. Take the inverse transform, which will now have 2N 
values. Half of these agree with {/}, the other half being midpoint interpolates, (a) 
Write a short program to illustrate the method, (b) What adjustment is necessary to 
compensate for the change in N? (r) What should be done to interpolate three values 
between the given values of {/}? (d) Compare with other methods of sinc-function in¬ 
terpolation. C> 
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A STRICTLY RECIPROCAL REAL TRANSFORM 

Given a real waveform V(f), we can define the integral transform 

0( w) = (27r)"'| V'(f)(cos cot + sin < ot)dt , (1) 

where the integral exists. The waveform may be complex, but will be taken as 
real in what follows, and may contain generalized functions such as delta func¬ 
tions and their derivatives. Clearly is a sum of double-sided sine and cosine 
transforms from whose reciprocal properties one readily deduces the inverse re¬ 
lation 


V(t) = (27r) i//(w)(cos cot + sin cot) dco. (2) 

These relations (p. 200) were presented by Hartley (1942) and never disap¬ 
peared from the technical literature, but have not been well known. The direct 
and inverse relations are identical in form and if the given waveform V{t) is real, 
so is its waveform i}j(co). 

To connect the transform ( {/(co) with the Fourier transform S(w) of V{t), it pavs 
us to adopt the definition 

S(o>) = (2ir)“* J ' dt 


'Reprinted with permission from /. Opt. Soc Ant., vol. 73, no. 12, December 1983. pp. 1832-1833. 
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and its inverse 


V(f) = (2 tt) > j ' SMe ,w ' lico. 

Let 1/7(07) = e(u)) + 0(07), where e(io) and o(w ) are the even and odd parts of 1/7(07), 
respectively. Then 

1/7(07) + i//(—o») , (> 

e(w) =---= ( 2 - 77 -) 5 l^(f)cos cot dt 

2 J -« 

— ip(—(i)) , f x 

and o(a>) =---= ( 2 -n-) 5 V(t) sin <otdt. 

2 i -«• 

Given 1/7(07) we may form the sum e ( a >) — io(co) to obtain the Fourier transform 
S(co): 

S(ce) = e(io) - io{a>) = ( 27 r) * V( 0 (cos o 7 f ~ i sin iot)dt . ( 3 ) 

Thus we see that from 1/7(07) one readily extracts the Fourier transform of V'(f) by 
simple reflections and additions. 

Conversely, given the Fourier transform S(w), we may obtain 1/7(07) by noting 

that 

1/7(07) = Re [S(o 7 )] - Im [S(o 7 )]. ( 4 ) 

Thus from S(o7) one finds 1/7(07) as the sum of the real part and sign-reversed imag¬ 
inary part of the Fourier transform. 


NOTATION AND EXAMPLE 


As an example take 


Then 


and 


v(0={7 ( ~' /2) 


t > 0 
t < 0. 


S(07) 

1/7(07) 


1 — 707 
1 + 07 2 


(27r)-(l + 07) 
1 + «7 2 


Figure 12.1 shows V(t) on the left and the Fourier transform S(o>) on the right; 
the real part of the transform is a broken line and the imaginary part is dotted. 
The imaginary part has been reversed in sign. Hartley's transform, shown by the 
full line, is simply the sum of the real part and the sign-reversed imaginary part 
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Fig. 12.1 On the left a waveform V(f) and on the right the real part of the spec¬ 
trum S(o>) (broken), the sign-reserved imaginary part of S(to) (dotted) 
and Hartley's transform of V(f) (full line). 


of S(w). It is real and clearly unsymmetrical. From its even and odd parts we could 
readily reverse the construction to recover the real and imaginary parts of the 
complex-valued Fourier transform S(o>). 

For historical continuity we have retained the elegant factors (2tt') : used by 
Hartley. But in what follows we drop these factors and move to the more famil 
iar notation where the 27r appears only in the combination 2tt x frequency. 


THE DISCRETE HARTLEY TRANSFORM 


Now consider a discrete variable t that is like time but can assume only the N in¬ 
tegral values from 0 to N — 1. Given a function /(t), which one could think of as 
the representation of a waveform, wc define its D1 IT to be 


H{u) = n 1 X/( T ) cas (^77^)' ( 5 ) 


where cas t) = cos 0 + sin 0, an abbreviation adopted from Hartley. For com¬ 
parison, the discrete Fourier transform F(u) is 


rw = N''sV(>)«p(— 


The inverse DHT relation is 


N - 1 


/(r)= 2»(„)cas(^) 


(6) 


To derive this result we use the orthogonality relation 
v-i /o-.-x -'X fN 

.0 


^ ( 2ttvt\ (2ttvt’\ f( 

.?„ cas orj cas bH = (< 


T = T 
T t T *. 
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Substituting (5) into the right-hand side of (6), 


l„ HWcas (^f) = 1 N 

- n % 

2/(0 x {; 

t '=0 


= N 1 
= f(r). 


N 

.0 


r = t 
r ^ t' 


which verifies (6). 

We see that the DHT is symmetrical, apart from the factor N" 1 which is fa¬ 
miliar from the DFT, and it is real. 

The DHT could be made strictly symmetrical by changing the factor AT 1 in 
the definition of the DHT to N 1 2 Then changing the definition of the inverse 
DHT to include a factor N~ l/2 we would have a strictly symmetrical transforma¬ 
tion. Hartley ensured the symmetry of his original integral relations by such 
means. However, it is often convenient when computing to stop short of multi¬ 
plication throughout by the constant factor and simply allow it to be absorbed 
into a normalization factor or graphics scale factor that will be introduced later. 
To indicate this relatively benign asymmetry we may say that the DHT is quasi- 
symmetrical. 

To get the DFT from the DHT, split the latter into its "even" and "odd" parts. 


where 


H{v) = E(v) + O(v), 

„ , H(i/) + H(N - v) 

£(") = - ;- 


and 


H( v) - H(N - v) 
O(v) = —--- 


Then the DFT is given by 

F(v) = E(v) - iO{v). 

Conversely, H{v) = &[f vvcn ] - 

As the real, strictly invertible, integral transform which forms the basis for 
the present discrete formulation was originally presented in 1942 by Ralph V. L. 
Hartley, it is appropriate to name the DHT, derived from his idea, in his honor. 
Hartley was a Rhodes scholar, a Fellow of the Institute of Radio Engineers, and 
rose to be in charge of telephone line research at the Bell Telephone Laboratories 
(1918-1929). To generations of electrical engineers his name was well known 
through the Hartley oscillator, which was once the standard textbook example of 
an electronic sine-wave source. A simple system to analyze, it comprised a single 
triode amplifier with feedback derived from a tapped inductance. For a bibliog- 
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raphy of hundreds of papers see the special issue of Proc. IEEE, March 1994, with 
a special section devoted to Hartley transform (edited by K. J. Olejniczak and 
G. T. Herdt). For subsequent papers use the Science Citation Index. 


EXAMPLES OF DHT 

For comparison with Fig. 12.1, consider 

ro .5 r = o 

}{T) lexp ( — t/2) t = 1 , 2 .,15, 

which represents the earlier function of continuous t by N — 16 equispaced sam¬ 
ples. The value at r = 0, since it falls on the discontinuity of V{t), is assigned as 
[1^(0 + ) + V(Q-)}/2 = 0.5. The result for H[y), which is shown in Fig. 12.2, closely 
resembles samples of the transform of Fig. 12.1 taken at intervals 1io/2tt = 1/16. 

The discrepancies, which are small in this example, are due partly to the trun¬ 
cation of the exponential waveform and partly to aliasing, exactly as with the DFT. 
As a final example, take the binomial sequence 1, 6, 15, 20, 15, 6, 1 representing 
samples of a smooth pulse. To obtain the simplest result assign the peak value at 
r = 0. Thus 

t, v = 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15, 

/(t) = 20 15 6 1 0 0 0 0 0 0 0 0 0 1 6 15, 

H(u) = 4 3.56 2.49 1.32 0 0.12 0.01 0 0 0 0 0.12 0.5 1.32 2.49 3.56. 




Fig. 12.2 


A 16-point representation of the truncated exponential waveform as used 
in Fig. 12.1 (left) and its DHT (right). 
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Fig. 12.3 Samples representing a smooth binomial hump (left) and its DHT 
(right). 


The result shown in Fig. 12.3 is the expected smooth pulse peaking at v — 0. 
For numerical checking it is useful to know that, as for the discrete Fourier 
transform, the sum of the D1 IT values ^LH(u) is equal to/(0). Conversely, the sum 
of the data values 2 /(t) is equal to NF( 0). 


DISCUSSION 

At first sight it may seem strange that N real values of the DHT can substitute for 
the N complex values of the DFT, a total of 2 N real numbers. We can understand 
this, however, by remembering that the Hermitian property of the DFT means re¬ 
dundancy by a factor of 2. The N/2 real numbers that suffice to specify the co¬ 
sine transform combine with the N/2 needed for the sine transform to form a to 
tal of N DHT coefficients containing no degeneracy due to symmetry. 

The function cas 0, which may be thought of as a sine wave shifted 45°, au¬ 
tomatically responds to cosine and sine components equally. If, as a kernel, we 
use 2 sin (V + «), where « is an arbitrary shift, the responses will be unequal but 
no information will be lost unless a = 0, tt/2 .Consequently one would ex¬ 

pect to be able to invert; the inversion kernel is cot rr sin 0 + tan 5 a cos 0. 


A CONVOLUTION ALGORITHM IN ONE AND TWO DIMENSIONS 

The convolution theorem obeyed by the DFIT is as follows. If f(r) is the convo¬ 
lution of /i(r) with / 2 (r), i t*., 

f(r) - /,(") * f 2 (r) = X/iK)/^ " r’) f 

7-0 
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then H(v) = H,(r>)H 2 » + 

where H(v), H^v), and H 2 (t') are the DHTs of /(t),/,(t), and / 2 (t), respectively, 
and U 2 [y) = H 2 ,.(e) + H 1{ ,{v), the sum of its even and odd parts. 

A customary way of performing convolution numerically is to take the dis¬ 
crete Fourier transform of each of the two given sequences and then to do com¬ 
plex multiplication element by element in the Fourier domain, which will require 
four real multiplications per element. Then one inverts the Fourier transform, re¬ 
membering to change the sign of i. Analogous use of the Hartley transform for 
convolution will require only two real multiplications per element. 

However, it very often happens, especially in image processing but also in 
digital filtering in general, that one of the convolving functions, say / 2 (t), is even. 
In that case H 2o (*') is zero, and the convolution theorem therefore simplifies to 
H(v) - H l (v)H 2 (v). In view of this simplified form of the theorem one need only 
take the DHTs of the two data sequences, multiply together term by term the two 
real sequences resulting, and take one more DHT. Thus the proposed procedure is 

/,(r) */ 2 (t) = DHT of [(DHT of/,) x (DHT of / 2 )]. 

Before taking the DHT, one extends the given sequences to twice the original length 
with zeros in order to have space for the convolution. The zeros may lead, trail, or 
bracket the data. When the sequences to be convolved are of unequal but compa¬ 
rable length, the method of extending with zeros and multiplying transforms may 
be used; but if one sequence is much shorter than the other, as is usual in digital 
filtering, then direct convolution is recommended (see Chapter 3 for simple code). 

For image processing in two dimensions exactly the same procedure is avail¬ 
able and the advantages of avoiding complex arithmetic and nonreciprocal sub¬ 
programs are increased. 


TWO DIMENSIONS 

Manipulation of two-dimensional images may also benefit from the existence of 
a real transform. An image /(t,,t 2 ) represented by an M x N matrix does indeed 
possess a two-dimensional discrete Hartley transform ( 2 DHT) which is itself an 
M X N matrix H(v l ,v 2 ) of real numbers, l'he transformation and its inverse are 

H(i'i,v 2 ) = M ‘N 1 /(t,, 7 2 ) cas 2-(r,T 1 + e,- 2 )], 

T| = 0 IS = 0 

A1 

/(TuT 2 ) = X S H(v u v 2 ) cas [27r(i',r, + e 2 r 2 )]. 

I'l -0 l'2 = () 

The two-dimensional Hartley transform can be broken down into N one¬ 
dimensional transforms as explained b\ Bracewell et al. (1986) or can be done 
more efficiently (Meher, 1992; Yang, 1989). 



300 


The Fourier Transform and Its Applications 


A convenience of the Hartley transform in two dimensions is that it may be 
presented as a single diagram representing the full spectral analysis of an image, 
whereas the Fourier transform of an image, which is hardly ever published, re¬ 
quires two diagrams, either for the real and imaginary parts, or for the amplitude 
and phase. Use of this presentation in optics is exemplified in Bracewell and Vil¬ 
lasenor (1990). A striking example of the Hartley transform of a spiral slit, pre¬ 
pared by j. Villasenor, appears on the cover of the Proceedings of the Institute of 
Electrical and Electronic Engineers, March 1994, while on pp. 587 and 588 of 
Bracewell (1995b) a complex Fourier transform of a 2D object can be contrasted 
with the single real Hartley diagram that contains the full phase and amplitude 
information about the object. Computer storage of a two-dimensional transform 
as a single real array has the same convenience as the graphical representation. 
Where phase is not included in the presentation, the two-dimensional power spec¬ 
trum is the same for both transforms. 

For three dimensions, see Hao and Bracewell (1987), and for four dimensions 
see Buneman (1987). 


THE Cas-Cas TRANSFORM 

In two dimensions, instead of the kernel cas;27r(r' ) 7| + v 2 t 2 )] one may use 
cas 27re,Ti cas 27tv 2 t 2 , the distinguishing feature of which is to be separable 
(Perkins, 1987). The cas-cas transform is reciprocal (Bracewell, 1983) and is related 
to the standard two-dimensional Hartley transform in the same way that arises 
when choosing between Fourier components of the form cos 277 [(i',t 1 + v 2 rf)], 
representing corrugations on the (i^f^-plane with parallel null loci, and those of 
the form cos 277^,7, cos 2tto 2 t 2 , whose null loci intersect at right angles. The choice 
of kernel has also been discussed by Millane (1994) who gives additional refer¬ 
ences. Separability has not proved to be a basis for preference; consequently the 
kernel cas[27r(r,T 1 + v 2 ~ff\ has become the standard. 


THEOREMS 

There is a Hartley transform theorem for every theorem that applies to the Fourier 
transform, some of the theorems corresponding exactly, as with X//(e) = /(0) and 
X/(r) = NH(0). Likewise, the Hartley transform of most convolutions is the 
product of the separate Hartley transforms, as mentioned above. In other cases 
there are differences. For example, the shift theorem, needed in implementation 
of the fast Hartley algorithm, is 

DHT of /(t + a) = H(r) cos “ H(-»/) sin 
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There is a quadratic content theorem 

s'[/M) 3 = N 2l»wP 

r 0 i-l) 

which resembles the analogous theorem for the discrete Fourier transform except 
that no complex conjugates enter, only real numbers. 

According to the reversal theorem, /( —r) has DHT H(—v), where the nega¬ 
tive arguments are interpreted modulo N; that is, where the argument falls out¬ 
side the range 0 to N - 1, add or subtract multiples of N as needed. 

The first difference theorem states that f(- + 1) - /(t) has DHT 
[cos(27re/N) — 1 — sin(2?re/N)H(N - //). 


THE DISCRETE Sine AND Cosine TRANSFORMS 


Many examples of the integral cosine transform of /(a), defined earlier as 
2 | 0 x '/(v)cos 2t7s\i<\, are obtainable directly from the Pictorial Dictionary of 
Fourier Transforms by looking for purely even graphs, in either column. In ad¬ 
dition, cosine transforms can be arrived at algebraically by extending a function, 
given for v s 0, to the left so ns to generate an even function and then applying 
any of the various techniques for obtaining Fourier transforms. Were it not for ex¬ 
tensive tables (notably Erdelvi's Tables of Integral Transforms) that exist for 
Fourier sine and cosine transforms of functions from advanced mathematics, these 
transforms might be regarded as merely special cases of the Fourier transform. 

The cosine transform has a discrete version £„ '/(r) cos(27 tvt/N) (and like¬ 
wise for the sine transform), but this discrete transform cannot be inverted to re¬ 
cover f(r) because components of /(r) of the form sin (tti't/N) are integrated out 
and leave no trace. The sine and cosine transforms themselves are invertible, but 
only when attention is restricted to functions f(x) that are zero for negative x. One 
could say that the discrete form of the cosine transform is invertible, but only 
when attention is restricted to functions f(r) that are even [in the sense that 
/(r) = f(N — t) for r = 1 to N — 1 ]. 


Boundary value problems. Useful invertible discrete sme and cosine trans¬ 
forms are generated if in place of frequencies 0, 1/N, 2/ N, 3/N ... , as above, we 
change to 0, \/N, 1/N, 1 =S/N, .... The fundamental frequency is now 1/2N and the 
fundamental period is 2 N. Consider the discrete sum 

X f{r)s\n{-m>T/N) 

? i 


For this operation, attention is restricted to values of t from 1 to N — 1; if a 
value is assigned to/(()), the value will leave no trace, even it the sum Xr = o' * s 
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evaluated, because the basis functions su\(ttvt/N) all have a null at r = 0 . This 
operation, if applied twice in succession, returns /(t). Thus we can define a 
discrete sine transform 


F s( v ) = ^f(T)sm(TTVT/N) 


with an inverse 


/(t) = 2 F s {v) sin (vvt/N). 

v=\ 

The corresponding discrete cosine transform F r (v) is 

F c (*0 = j; 2 /( T )cos (ttvt/N). 

Af T=0 

However, to recover /(r), given F f ( v), is algebraically complicated. A fast algo¬ 
rithm COSFT, that depends on the FFT, appears in Press ct al. (1986). A revised 
definition introduced in the second edition (1992) based on N + 1 data values is 
strictly symmetrical: 

°fm = + (-mm + "|/(,)c«wk)}. 

A related DCT (Rao and Yip, 1990) departs from the smooth cosinusoidal ba¬ 
sis functions used above, for example by substituting 1/V2 for unity where the 
argument of cosine is zero. Thus 

' F c(v) = 2 K/{t)cos{7tvt/N), V = 0 to N. 

The factors k v and k T are unity, except when the subscript is zero or N, in which 
case the value is 1/V^. 

Whereas hitherto N was the number of elements comprising /(t), here it is 
the number of elements minus 1 (there are N + 1 elements). This transform is 
strictly symmetrical: 

[2 " 

/( T ) = yj JjK 2 K‘ F M cos {ttvt/N), v = 0 to N, 

and is known as DCT1. 

A body of lore for the solution of differential equations without involving 
complex Fourier analysis is responsible for the importance of the discrete sine and 
cosine transforms. As a simple example, if a violin string of length L is drawn 
aside at a noncentral point and one wishes to study the consequences, it is not 
necessary to apply full Fourier analysis of the string shape y(x). Components re¬ 
stricted to the series sin(7rr/L), sin(27rr/L), sm(37rx/L), and so on, suffice to syn- 
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thesize the string shape because the boundary conditions y(0) = 0 and y{L) = 0 
render cosine terms unnecessary. Ln another problem where, instead of y(0) = 0 
the boundary condition is that [dy/dx] x =0 L equals zero, cosine components alone 
may suffice. While it is certainly possible to do these boundary value problems 
with the full Fourier transform, it is not customary. Normal Fourier analysis would 
yield both sine and cosine components instead of just one kind alone. Thus, tak¬ 
ing L = 1 and 


fix) 


'2x 
1 - x 
.0 


0 < x < a 
a < x < 1 
elsewhere 


then the complex Fourier transform is 

. 1 . , 1 , .sin 2tts — 3 sin liras 

F(s) = sine s — ~a sine as + i - -r-z - 

w 2 2 4 tt 2 s 2 


Inverting, f(x) may be expressed as |“ oo F(s)e’ 2m:x ds, where the integrand is com¬ 
plex. 

But for the range 0 ^ x oo, we can also write the simpler relation 



«= sin 2 -tts — 3 sin lira s 
o 47T 2 S 2 


sin lirsx ds. 


where the integrand is purely real, consisting only of sine waves of different am¬ 
plitudes and frequencies. 

No matter how complicated the initial shape of the string may be at the mo¬ 
ment of release, and whether or not any symmetry or antisymmetry is present, it 
is striking that the string shape can be analyzed into sine components alone. Waves 
in a canal with closed ends can be analyzed into cosine components alone. 

Fields of physics involving the wave equation, Laplace's equation, the diffu¬ 
sion equation, and other fundamental differential equations in two, three, and 
four dimensions, provide a wide range of application for numerical analysis us¬ 
ing the discrete sine and cosine transforms. 


Data compression application. When images have to be transmitted digitally 
computers are generally not fast enough to preserve photographic quality, but much 
successful effort has gone into reducing the number of bits transmitted while si¬ 
multaneously minimizing deterioration of the received image. If an image repre¬ 
sented by a million samples, each sample quantized to 256 levels, has too many bits 
for some purpose, then a fourfold reduction in the number of bits will result if sets 
of 2 x 2 pixels are replaced by one pixel, to which is assigned the mean value of the 
pixels replaced. The deterioration will consist of blurring describable as convolu¬ 
tion followed by coarser sampling. If the image is printed with typical newspaper 
quality, spread over an area about the size of a sheet of letter paper, the blurring 
will be distinctly noticeable to the eye. There will be an additional 32-fold reduc¬ 
tion in the number of bits because newsprint offers only about eight grey levels. 
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but for many purposes, such as recognizing a face, this would be acceptable dete¬ 
rioration. It is clear that the criteria of acceptability will involve the psychophysics 
of vision and the character of the image in addition to the digitizing procedure. 

Empirical study shows that many images when subjected to spatial harmonic 
analysis have little content at high spatial frequencies. This suggests transmitting 
the Fourier transform of the image, but with the higher frequencies suppressed 
or deemphasized (for example by quantizing to fewer levels). At the receiving 
end, inverting the transform will yield an image whose deterioration may be ac¬ 
ceptable. This procedure is known as transform encoding. Whether such data com¬ 
pression is implemented in the image domain or in the transform domain, all 
parts of the image are treated equally; still, it is apparent that blurring is less ac¬ 
ceptable in some areas of an image than in others: on a page of text for example. 
Therefore, further gain can be achieved by one-dimensional data manipulation 
such as run-length encoding, TIFF encoding, and delta-row encoding. Segmenta¬ 
tion of an image into parts characterized by more or less uniform spatial statis¬ 
tics offers further opportunities. 

When statistical properties of images are taken into account, data-compres- 
sion advantages may be claimed on behalf of one transform over another. Such a 
preferred transform, and its inverse, are defined by 

2/( T ) cos 2t + 

/( T ) = 2 a(v) n F(v)cos ~(2 t + l)v , 

v=o 

where a(i') = 1 except that a(0) = l/\/2. The transform F(v) was introduced as 
"a DCT" by Aluned, Natarajan, and Rao (1974). This influential letter ultimately 
led to mention of this DCT in an international standard described in Pennebaker 
and Mitchell (1993). It is known as DCT2 (Rao and Yip, 1990). 

The DCT2 analyzes into frequencies 0, j/N, 1/N, l\/N, .. . just as the DCT1 
does, but the samples are lime shifted by half a unit and the basis functions are 
not exactly cosinusoidal. Thus the cosine factor is no longer unity at t = 0 but 
has a variable value cos(7tv/2N). Nevertheless, the basis vectors are orthogonal. 
The transformation is not strictly invertible; that is, if applied twice in succession, 
it does not return the original object. Familiar theorems for the DFT and the Hart¬ 
ley transform, the shift and convolution theorems, for example, become opaque. 
For computation it is found convenient, as exemplified by Press et al. and MAT- 
LAB (which offers an operation dct(f)), to rearrange the data so that the FFT 
can be applied. Alternatively see code that has been published by several authors 
to apply the Hartley transform to arrive at DCT2 (p. 65 of Rao and Yip, 1990). The 
main distinguishing advantage claimed for the DCT2 is favorable performance as 
judged empirically on images whose statistics approximate spatially uniform first 
order Markov statistics. Transmission of text images may not benefit much from 
data compression nor will time signals such as ASCII or cellular telephone trans¬ 
missions, or digitized speech or music. 
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COMPUTING 

The properties of the discrete Hartley transform commend themselves for appli¬ 
cation to numerical analysis. Where speed is of the essence one may use the "fast 
Hartley transform" (FHT) described next. Many users' programs will run signif¬ 
icantly faster with a fast Hartley transform than with the FFT; and on personal 
computers the simplicity of the Hartley transform is an advantage. The practice 
of making up pseudo-complex data from real data to suit the character of the 
Fourier transform has been obsoleted by the introduction of means for operating 
directly on real data (Buneman, 1986). 

A theoretical convenience of the Fourier transform is that its complex kernel 
is an eigenfunction of a linear time-invariant operator. This algebraic property is 
valueless in the computing environment, neither the sine, cosine, nor cas function 
being an eigenfunction. 


GETTING A FEEL FOR NUMERICAL TRANSFORMS 

Experience with Fourier integral transform pairs presented graphically, as in the 
Pictorial Dictionary, develops a feeling for the interpretation of frequency analy¬ 
sis that transfers readily to the corresponding numerical transforms. Of course, 
the practice of avoiding negative indices, which is inherited from early program¬ 
mers, clashes with the idea of negative frequency that is imbedded in mathe¬ 
matical analysis as exemplified by 

cos cot = 

2 2 

The analysis of a cosine function into two frequencies, one negative and one posi¬ 
tive, each with amplitude is reinforced by that familiar diagram where there is a 
cosine on the left and two half-strength impulses on the right (Fig. 6.1). If cos (27rf/4), 
which has period 4, is discretized at unit interval of t, one would connect that di¬ 
agram with the discretized version if the pair were presented numerically as 

r = 0 v — —2 v — +2 

... 0 -10 10 -10 . 0-^0 0 +§ 0 0 ... 

waveform spectrum 

For sin (27rf/4) we would also recognize 

T = 0 V — 0 

...10 -1010 -1 . 00 +^ 000 -5 00 ... 


waveform 


spectrum 
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and if some d.c. were added, say of strength 2 , the graphical form of the state¬ 
ment 

cos(27ri/4) D \S(t + 1) + 28(f) + l 2 S (t - 1) 
would connect with 


T — 0 V = 0 

...2123212.00+| 020 +| 00.... 

waveform spectrum 

The origins of time (r = 0) and of frequency (v = 0) have been emphasized 
by bold type. 

However, the indexing convention presents us with the following for the three 
examples above. 

r — 0 v — 2 v = 6 

{ 10-1 0 10-1 0 }D {0 0 \ 0 0 0 \ 0 } 

{0 1 0-101 0 -1} D {0 0 0 0 0 \ 0} 

{3 2 1 2 3 2 1 2} D {2 0 \ 0 0 0 \ 0} 

The frequencies 1/8, 2/8, 3/8, and 4/8 are represented by y-values of 1, 2, 3, 
and 4, while frequencies —1/8, —2/8, —3/8 are represented by e-values of 7, 6 , 5 
respectively. 

We recall that v/N gives the frequency, for nonnegative frequencies 
(0 v « N), while a negative frequency such as —0.25, which could have fallen 
at v = —2 if negative indices were allowed, is placed at —2 mod 8 , i.e., at v = 6 . 
When we look at a numerical spectrum, the first element gives the d.c. value (just 
as the leading Fourier series coefficient a 0 does), while a frequency/ is represented 
at the two locations v = (± Nf) mod N. Cosine components have equal values at 
these locations; sine components are equal with opposite signs. 

All of the above examples apply to the discrete Fourier transform and to the 
discrete Hartley transform. For the other real valued transforms there is more to 
be said. For comparison, here are the three transforms presented above for both 
the DCT1 (middle) and the DCT2 (right). 

/(r) DCT1 DCT2 

(1 0 -1 0 1 0 -1 0)1.11 .47 .32 1.31 1.31 -.32 .41 -.11|(0 .53 0 1.09 1.41 -.73 0 -.11) 

(0 1 0 -1 0 1 0 -11(0 1 0 -1 0 1 0 -11(5.66.53 0 1.09 1.41 -.73 0 -.11) 

(3 2 1 2 3 2 1 21(5.49.41 .12 1.31 1.75 -.32 .85 —.11) (0 .53 0 1.09 -1.41 0 -.73 -.il) 


»g 

THE COMPLEX HARTLEY TRANSFORM 


Since the radiation pattern of an antenna is expressible as the Fourier transform 
of an aperture distribution of an electromagnetic field, and since a lens ran con- 
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vert an optical aperture distribution to another distribution that is similarly ex¬ 
pressible, it might appear that the Hartley transform is a mathematical construct 
without physical interpretation. However, an intimate relationship exists between 
the two transforms such that, whatever property one of the transforms may pos¬ 
sess, a corresponding property is possessed by the other. This relationship can be 
explained with the aid of a diagram introduced in Fig. 2.10, where the real and 
imaginary parts of a Fourier transform F(s) are plotted as a locus on the complex 
plane of R = Im F versus S = Re F, each point on the locus parameterized by a 
value of s. If a second coordinate system R’,S' is constructed by rotating the R- 
and S-axes through —45° and the component in the R' direction is read off as a 
function of s, the result will be the Hartley transform. If on the other hand the 
component in the S' direction is examined it will be found to add no information, 
in the case of the transform of a real function f(x). The transformation 

R'(s) + if'(s) = [R(s) + il(s )] X e m/4 

describes the intimate relationship between the two transforms. The complex- 
plane locus can be reconstructed from R(s) and J(s) together; but the absence of 
the redundancy associated with the symmetries of R(s) and f(s) permits the real 
f(x) to be recovered from the component in the R'-direction alone, or indeed from 
any direction save only the R- and S-directions. 

For an original function f{x) representing complex data, the S'-direction han¬ 
dles the additional information; the Hartley transform, as conventionally defined, 
then becomes complex. Millane (1994) gives an extended treatment of the com¬ 
plex Hartley transform. 


PHYSICAL ASPECTS OF THE HARTLEY TRANSFORMATION 

From this complex-plane view the construction of the Hartley transform in phys¬ 
ical space can be derived (Bracewell, 1989). The first apparatus to demonstrate 
the possibility of phase recovery from a real electromagnetic field distribution uti¬ 
lized an optical beamsplitter (Bracewell et al., 1985; Bracewell, 1986; Villasenor 
and Bracewell, 1987; Villasenor, 1989) and Michelson interferometer technique. 
Later, appropriate substitution of microwave elements enabled the wavelength 
range of feasibility to be extended (Villasenor and Bracewell, 1988). 

In the Hartley plane, phase is encoded by amplitude alone; in fact when 
the apparatus is in proper adjustment the plane is in isophase, except for the 
phase reversal where the mathematical Hartley transform would be negative. 
The possibility of obtaining electromagnetic phase by amplitude or intensity 
measurement alone is of technical interest because at ultraviolet and x-ray 
wavelengths phase is important but difficult to measure. Implementation with 
x-rays has been discussed but will be technically difficult and needs further con¬ 
sideration. 
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THE FAST HARTLEY TRANSFORM 

A sequence of N real numbers possesses a discrete Hartley transform (DHT) that 
is a sequence of the same length and is also real valued. From the DHT one can 
return to the original sequence by applying the same transformation formula a 
second time. The convenience of not having to manage the real and imaginary 
parts either in separate arrays, or interleaved in one array of double length, or in 
other ingenious ways that have been adopted in various embodiments of the 
Fourier transform commends the DHT for consideration in applications to nu¬ 
merical spectral analysis and convolution. Not having to allow for an inverse 
transformation that is different and differs among authors is also helpful. 

The DHT is a suitable substitute for the discrete Fourier transform (DFT) for 
some purposes; however, if the real and imaginary parts of the DFT are expressly 
required, then they are directly obtainable as the even and odd parts of the DHT. 
When the power spectrum is the desired goal, it may be obtained directly from 
the DHT without first calculating the real and imaginary parts of the DFT as in 
the usual way of calculating power spectra. 

A fast algorithm has been developed for computing the DHT and, by anal¬ 
ogy, with the fast Fourier transform will be referred to as the fast Hartley trans¬ 
form (FHT). A subprogram appears in an explanatory context in Bracewell (1986) 
under the name FHTSUB. At the end of this chapter a condensed radix-4 version 
appears. In order to make the material as accessible as possible to personal- 
computer users the program is presented in pseudocode that is as free horn idio¬ 
syncrasies as possible and ready to be transcribed into any current computer lan¬ 
guage. 

In addition to the convenient features mentioned, the FHT is faster than the 
complex FFT by a factor that depends on circumstances discussed below. There 
are one-way programs related to the FFT that are available for operating only on 
real data and save time by omitting the computation of those coefficients that are 
complex conjugates of other coefficients. Nevertheless, the real input leads to com¬ 
plex output; to invert the complex output requires storage of an additional one¬ 
way program which is suitably modified to accept complex data and which saves 
time by not computing imaginary parts. By comparison the FHT, which is bidi¬ 
rectional and real-valued, is simpler and more elegant. Neither of the fast one¬ 
way programs can accept its own output. For later developments see Guo et al. 
(1998). 

When the fast Hartley algorithm appeared in 1984 some incredulity was ex¬ 
pressed about the merits of speed, reality, and reversibility claimed for it by com 
parison with the familiar FFT, but hundreds of papers appeared (Olejniczak and 
Heydt, 1994), chips were manufactured for incorporation into commercial in¬ 
struments, and the physical significance of the Hartley transform was demon¬ 
strated in the laboratory with microwaves and visible light. Engineering applica¬ 
tions answered a criticism that the Fourier transform was a property of nature 
whereas the Hartley was not, a difficult claim to defend, seeing that complex num- 
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bers are a mental construct. It soon became clear that the relationship is very in¬ 
timate, amounting to full equivalency. 

We recall that for a real function /( t), for t = 0,1,..., N — 1, one defines the 
discrete Hartley transform H(v ) by 

N-i / 27 tvt\ 

H(v) = N~ l 2 /(r) cas J, * = 0,1. N - 1. 

The inverse relation is 

f(r) = 2 HW ras (—J, r = 0,1. N - 1. 

The integer r can be thought of as a mnemonic for time, while i^/N, where 
v =s N/2, is like frequency measured in cycles per unit of time. 


THE FAST ALGORITHM 

If the DHT is evaluated numerically from its defining expression, the time taken 
for long data sequences of length N is proportional to N 2 as with the DFT, be¬ 
cause for each value of v there are N evaluations of the product /(r) cas (27 tvt/N) 
and there are N values of v. Let N be expressible as 2 raised to some power P, i.e., 
N = 2 r . Just as with the FFT, the number of arithmetic operations can be reduced 
to the order of N log 2 N or NP. 

One way of proceeding is shown in the flow diagram of Fig. 12.1 for the case 
of N = 8, P = 3. The operation labeled PERMUTE, discussed further in a later 
section, rearranges the sequence of data. The zth member is placed into the yth po¬ 
sition where j may be calculated from i as follows. 

R - 1 
J = 0 

FOR K = 1 TO P 
S = R DIV 2 
J = J + J+ R- S- S 
R = S 
NEXT K 

The purpose of permutation is the same as with the FFT, namely, to bisect the 
data sequence progressively until data pairs are reached. Bv definition when 
N = 2, 

{a b} has DHT \{a + b a — b } 

which is very simple. To superimpose all the two-element transforms requires a 
decomposition formula that expresses the DFT of a given sequence in terms of 
the DHTs of subsequences of half length. This formula permits, for example, the 
DHT of a four-element sequence {flj a 2 b x b 2 } to be expressed in terms of the DHTs 
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of the two interleaved two-element sequences {a, fcj} and {a 2 b 2 ). To derive the de¬ 
composition formula, we require two theorems, the shift theorem and the simi¬ 
larity theorem. The shift theorem states that if /(r) has DHT H(v), then 

/(t + a) has DHT H(i>) cos — H(N - v) sin 


The similarity theorem, which is the same as for the DFT, states that if a sequence 
/(t) is stretched to double its length by inserting a zero element after each given 
element, then the elements of the original DHT are repeated. As examples, 

{12 3 4} has DHT {2.5 -1 -0.5 0}, 

{10203040} has DHT {2.5 -1 -0.5 0 2.5 -1 -0.5 0}. 

Both these theorems are derivable in one line from the DHT definition. Sup¬ 
pose that 


{«i a 2 b j b 2 Cj c 2 ...} has DHT H(v) 

where there are N elements. Then the a^ sequence of \N elements {«i b l c l ...} has 
DHT {a, jSj y x ...} and the a 2 sequence {a 2 b 2 c 2 ...} has DHT {a 2 j3 2 y 2 ...}. We see 
that 


H(v) = DHT of {a, 0 lb, 0 Cj 0 . ..} + DHT of {0fl 2 0 b 2 0 c 2 0 .. .} 

= ft Ti... «i ft y\ ■. ■} + DHT of {0 1} * {a 2 b 2 c 2 .. .} 

= Ayi---«i/3i?!•••} +jo* & cos (jv) 72 cos • 


-a 7 /S 2 cos 


2tt(N/2 + 1) 


|o...y 2 sin 

[ 


N 

2tt{N/2 - 2) 


y 2 cos 


f 2tt(N/2 + 2) 


N 


ft sin 


N 

2tt(N/2 - 1) 


} 


N 


0 ... 


72 sin 


\ 2tt(N/2 + 2) 
N 


fi 2 sin 


2t7(N/2 + 3)1 
N 


}■ 


The general decomposition formula is thus 

W(i') = H ai {v) + H ai (v) cos + HJN - v) sin 


where H tti (v) and H flj ( v) are |{«i ft y, ...a, ft y, ...} and \{a 2 0 2 7 Z • • • 
a 2 ft y 2 ■ • ■}, respectively. In this derivation we have put a = — 1 in the shift the¬ 
orem. In the first two operations following permutation on the left of Fig. 12.4, 
the sine and cosine factors assume only values of 0,1, or —1. For this reason the 
diagram can make use of two flow line types: unbroken lines that transmit val¬ 
ues unchanged and broken lines that transmit with a sign reversal- Tn later stages 
sine and cosine factors are associated with two-thirds of the flow lines; of course. 
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Fig. 12.4 Flow diagram for the discrete Hartley transform with N — 8 and P = 3. 

Broken lines represent transfer factors —1 while full lines represent 
unity transfer factors. The crossover boxes perform the sign reversal 
called for by the shift theorem which also requires the sine and cosine 
factors S M C„. 


many of these factors are still 0, 1, or —1. For the case of N = 16, Table 12.1 
summarizes the equations represented by the flow diagram using the level-de- 
pendent abbreviations C„ and S„ to stand for ^{2tui/2 1 ), respectively, where L is 
the level number of the stage. Table 12.2 shows how the equations in fact simplify 
when the special values 0, 1, — 1, and r = 2 _1/7 are substituted. The small boxes 
containing crossover connections that appear in one-third of the connections in 
the later stages (Fig. 12.4) are to implement the sign reversal demanded by the 
factor H(N — p) in the shift theorem. [When v = 0, H(N) is assigned the value 
0 )-] 

An example (Table 12.3) will clarify the steps involved. As will be seen, the 
computations for N — 8 can easily be carried out by hand. For illustration let the 
given data sequence be /(r) = {1234567 8}. Permutation proceeds in P - 1 
steps. The first step is to separate out the data into two four-element sequences 
{13 5 7} and {2 4 6 8}, as in the column headed tt. The second step separates each 
four-element sequence into two two-element sequences: {1 5}, {3 7}, {2 6}, and 
{4 8}. As P = 3, the second step is the last step of permutation. 

The sequence {15 3 7 2 6 4 8} is the permuted sequence / 0 (r). Each two- 
element sequence {a b} is now transformed; thus {1 5} gives j{6 -4}, but we sup¬ 
press the factors \ until the end. When concatenated, these elementary transforms 
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■ TABLE 12.3 

Numerical example of a short FHT with N = 8, P = 3 


T 

/M 

7T 

fcfj) 

fM 

Mr) 

/sM 

HM 

V 

0 

1 

l 


- 6~7 

16 

36 

4.5 


l 

2 

3 

5 

- -4 —A 

-8 

-13.6 

-1.7 

1 

2 

3 

5 

3 

10 // 

-4 

-8 

-1 

2 

3 

4 

7 

7 

-4 / 

0 

-5.6 

-0.7 

3 

4 

5 

2 

2 

8 

20 

-4 

-0.5 

4 

5 

6 

4 

6 

-4 

-8 

-2.4 

-0.3 

5 

6 

7 

6 

4 

12 

-4 

0 

0 

6 

7 

8 

8 

8 

-4 

0 

5.6 

0.7 

7 


constitute the first stage /i(t) = {6 —4 10 —4 8 —4 12 -4}. Owing to the 
degeneracy exhibited in Table 12.1, the steps for obtaining / 2 (r) are also very sim¬ 
ple. Thus 16 = 6 + 10, -8 = -4 - 4, -4 = 6- 10, 0 = -4 + 4, etc. Some 

of the flow lines from Fig. 12.4 are included in Table 12.3 to facilitate cross-refer¬ 
ence. In the final stage, computation of / 3 (r) involves sines and cosines of eighths 
of a turn. In the operation labeled COMBINE there are three sets of eight inputs 
each and one set of eight outputs. The first of the eight outputs is the sum of the 
first elements of the three input sets and similarly for the next outputs. 

We remember that a factor \ was suppressed P times so the result / 3 (t) must 
be divided by 8 to conclude that 

{1 2345678} has DHT {4.5 -1.7 -1 -0.7 -0.5 -0.30 0.7}. 

As a check we note that the sum of the data equals 8 times the first element of 
the DHT. A study by Hou (1987) led to a different flow diagram with features fa¬ 
vorable for VLSI implementation. 

If we wished to go on and get the DFT R(v) + jX{v), we would proceed as 
follows. The real part R(y) is equal to the even part of the DHT H{v), and the 
imaginary part X(v) equals the negative odd part. If we want the "power spec¬ 
trum" Z 2 — R 2 - 1 - X 2 , we do not have to go via the complex quantity R + jX; the 
power spectrum can be calculated directly from 


H 

RUNNING TIME 

It is of interest to know how the FHT compares with the FFT in speed. The ratio 
depends on several factors including the language and the machine; this paper 
reports on experience with the HP-85 personal computer which provided repeat- 
able run times. In order to normalize the numerical results, one may introduce a 
figure of merit Y as follows. In the FFT the innermost arithmetic operation is a 
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complex multiplication which can be carried out by four real multiples, although 
a very clever method with three multiplies was invented by O. Buneman (1973). 
One may determine the time T 4 for four real multiples by the following arbitrary 
but definite prescription: 


A=RND; B=RND; C=RND; D=RND 
T0=TIME 

FOR 1=1 TO 1000; R=A*C-B*D; X=B*C+A*D; NEXT I 
T4=(TIME-TO)/1000; PRINT T4; END 

Then the running time required to take the FHT of a sequence of length N = 2 r 
may be expressed as 

Tfht = YNPT 4 . 

For a standardized comparison I translated a well-known fast Fourier trans¬ 
form program so as to run on my computer (see later section). In the range 
1 < P < 11, Y ranged from 3.1 to 5.8. Using the fast Hartley transform to get the 
Fourier transform yielded Y = 1.3 approximately. Comparison with other pro¬ 
grams will require tests in a common language or languages, including assembly 
language, on a common machine. Programming style, which is important and ac¬ 
counts for some of the discrepancy in the test reported, also needs to be balanced. 
The fact that Y turns out to depend on N is an interesting reality that is not brought 
out simply by counting operations in the inner loop and will now be examined. 


TIMING VIA THE STRIPE DIAGRAM 

Running time dependence on N has been studied using a program given below. 
For this purpose, and to keep the program as clear as possible, some simplifica¬ 
tions have been adopted. For example, each successive stage is allocated to a sep¬ 
arate array F(L, /), where L is the "level" or stage number and I ranges from 0 to 
N — 1. In the notation used so far, F(L, I) = / L (/). However F(0, 1) is used first for 
the data /(r) and then reused for the permuted data / 0 (t). Stages 1 and 2 are then 
computed directly from the short equations of Table 12.2, without recourse to sines 
or cosines. After that an iterative loop is entered; as each stage is completed, ex¬ 
ecution returns to the beginning of the loop. 

By varying N we see how the components of Y behave in the "stripe dia¬ 
gram" of Fig. 12.5. There are three kinds of component to be prepared for. First 
there are some "overhead" operations that do not depend much, if at all, on N 
and can be expected to die out rapidly when the ordinate is normalized with re¬ 
spect to NP. Second, there are operations such as the precalculation of the needed 
sines and cosines of multiples of one Nth of a turn that are carried out a number 
of times proportional to N. (It is desirable to precalculate these factors; otherwise 
many of them must be redone many times.) Therefore, the contribution of the pre¬ 
calculation to the running time after division by NP dies out as P ' as exhibited 
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Fig. 12.5 Stripe diagram showing the figure of merit Y versus P (upper heavy 
curve) for the FHT program printed below and contributions made by 
overhead, data insertion, precalculation of powers of 2 and sines and 
cosines, permutation, and the various numbered stages. The additional 
time involved in going on to the real and imaginary parts of the discrete 
Fourier transform is shown by the top stripe. The ordinate scale on the 
left, which is specific to the author's personal computer, shows running 
time divided by NP. 


by the declining vertical thickness of the stripe labeled "C & S." A second exam¬ 
ple is the contribution of, let us say, stage 3. As N becomes larger, stage 3 requires 
more time in proportion to N. Therefore the thickness of the stripe labeled "3" 
also decays as P 1 . But, the number of such stripes increases as P; the zone 
bounded by heavy lines remains of approximately constant vertical thickness. 

The third kind of behavior is exhibited by the contribution from permutation. 
Permutation involves N reassignments of variables, repeated P times; so the time 
required is proportional to NP and the permutation stripe therefore does not die 
out. Any effort made to streamline permutation is consequently most valuable. 
Merely replacing J/2by0.5*J or 2 * J by / + / may make a significant im¬ 
provement in the end. 

Stages 1 and 2 have been lumped together for the purposes of the stripe di¬ 
agram. It is apparent that the stripe labeled "1 & 2" is of much the same width 
as the stripe for stage 3. When stages 1 and 2 were computed by the same gen¬ 
eral equations as for later stages there was a loss of speed that was quantified by 
timing and found to be significant. This is the justification for using the short 
equations of Table 12.2. Further, but diminishing, gains would also be realized 
from further postponement of iteration. 
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If the final step to the DFT is taken, a thin decaying band of the second kind 
is added on top, ultimately becoming negligible. 

The nondecaying zone, which is indicated by heavy lines in the stripe dia¬ 
gram, has a thickness of 0.038 s. This means that the running time, in the limit as 
P approaches infinity, will be 0.038 NP. In the neighborhood of P = 10 the run¬ 
ning time is about one-third more than this. By special tricks one might hope to 
erode this one-third. The widest component comes from pretabulation using built- 
in sine and cosine functions and can be substantially reduced by an algorithm 
due to O. Buneman (1986) or, as he explains, eliminated entirely when runs are 
repeated or dedicated hardware is introduced. Overhead and precalculation of 
powers of 2 are both negligible. Fetching and loading data are shown by this 
analysis to be also negligible in the current implementation. Permutation is pos¬ 
sibly near the ideal limit. 


MATRIX FORMULATION 


A different and condensed view of the fast Hartley operator may be gained by 
formulating the equations of Table 12.1 in matrix form. We may write 

H = N _1 L 4 L 3 L 2 L 1 Pf / 

where f and H are, respectively, the N-element column matrices representing the 
data/(r) and the discrete Hartley transform H(v), P is the permutation matrix and 
the L, are matrix operators which convert the column matrix operand to the col¬ 
umn matrix of level i. In this example with N — 16 and P = 4, i runs from 1 to 4. 
A subsequent step of conversion to the discrete Fourier transform F(y) may also 
be represented by the (complex) matrix multiplication 

F = <I>H. 

Combining the above equations, we obtain a new expression of the discrete 
Fourier transform: 

F = N 1 0)L P Lp_ 1 . • • LjPf. 

The matrix operator N _1 4>L P •.. thus represents a new factorization of the 
DFT matrix operator W, where F = Wf, W = exp (— Htt/N ) and 


1 1 1 
l w W 2 
1 W 2 W 4 


W = 


W<N-3) 2 W (N-3)(N~2) jy(N-lKN-3) 

w (N-2)(N-3) jytN-2) 2 w(N-2XN-D 
jY(N- 1XN-3) W<N-1XN-2) w(N-t) 2 
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The factors, which are directly verifiable from Table 12.1 are as follows: 
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In the above equations C„ and S„ are the level-dependent abbreviations for 
™(27rn/2 L ), respectively, and K„ = C„ + S„. 

The matrix representation offers a different way of viewing the fast Hartley 
procedure. For example, L 4 shows the retrograde indexing of the sine factors as 
elements on lines of slope 45°. Lj and L 2 do not have such elements at all. One 
might also notice that L t and L 2 have only 2 N nonzero elements compared with 
3 N in the limit for factors of higher level. Allowing for the time taken to access 
the trigonometric values, one may gain an intimate understanding of the empir¬ 
ical timing results of Fig. 12.2. 


CONVOLUTION 

In the vast majority of image processing applications, convolution is carried out 
between two functions of which one is symmetrical. Since two-dimensional con¬ 
volution performed on an image can be reduced to one dimension by spreading 
the image out serially as in a television waveform, it will suffice here to speak in 
terms of one dimension. Under conditions where /i(t) has no particular symme¬ 
try and is to be convolved with / 2 (r), which is an even function, the convolution 
theorem for the DHT is: 

/i(t)*/ 2 (t) has DHT fi,( v)H 2 (v\ 

In other words, the DHT of a convolution of this type is the product of the two 
separate Hartley transforms. Therefore, to perform convolution, we take the two 
DHTs, multiply them together term by term, and take the DHT again. This pro¬ 
cedure represents an improvement over taking the two DFTs, multiplying the 
complex values together and inverting, since one complex multiplication 
(a + jb)(c + jd) = ac — bd + j(ad + be) stands for four real multiplications. 

In the general case where / 2 (r) is not symmetrical, the convolution theorem 
has a second term. Let H 2 (v) = H^iv) + where and H 2o are the even 

and odd parts of H 2 (v). [If / 2 (t) were symmetrical then the odd part of H 2o (v) 
would be zero. ] The general convolution theorem then reads 

/i(t) * / 2 (t) = Hi(i')H 2 » + W 1 (-i^)H 2 o (v). 

This theorem is immediately deducible from the convolution theorem for the DFT. 

If convolution by the transform method uses up significant time the stage of 
permutation may be omitted, since the resulting misordering in the transform do¬ 
main affects both factors identically. If fast permutation as described in the next 
section is used instead of explicit bit reversal, the speedup is lessened. This re¬ 
finement becomes moot for users of built-in routines for transforms or transform- 
based convolution who value convenience over efficiency. 

When /,( ) and / 2 ( ) are of comparable but not equal length, the shorter se¬ 
quence may be extended with zeros in order to convolve by transform. However, 
with digital filtering of lengthy data f x ( ), the sequence f 2 ( ) that performs the fil¬ 
tering is much shorter; in that case direct convolution by computer is recom¬ 
mended (see Chapter 3). 
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PERMUTATION 

Given a sequence of eight elements/(i), where the index i = 0, ... 7, permutation 
rearranges the elements into the order /(0), /(4), /(2), /(6), /(l), /(5), /(3), /(7). Writ¬ 
ing the original index i in binary form i b we see that reversing i b (third row) and 


reconverting to decimal form 

produces the permuted index j 

• 


i 

0 

1 

2 

3 

4 

5 

6 

7 

4 

000 

001 

010 

Oil 

100 

101 

110 

111 


000 

100 

010 

110 

001 

101 

011 

111 

i 

0 

4 

2 

6 

1 

5 

3 

7 


How this step arises is well described by Press et al. (1990). Permutation, also 
called bit reversal, scrambling, or shuffling, may be implemented by repeated in¬ 
teger division by 2 and commonly is; but implementation by reversing binary dig¬ 
its turns out in retrospect to have been naive. Permutation takes a noticeable frac¬ 
tion of the execution time for a fast Fourier transform as shown in the classical 
timing diagram of Fig. 12.6. In the example given above, half of the indices, namely 
0, 2, 5, and 7, remain unchanged because their binary representations are sym¬ 
metrical, an observation showing that substantial time can be saved by skipping 
them. Looking for further simplification I plotted scatter diagrams of j versus i 
and found that all the diagrams break down into two basic cells (Fig. 12.6). 

The first of these calls for 4-element permutation by swapping the pair of in¬ 
dices, 1^2, while the second involves the 8-element example tabulated above. 



Fig* 12.6 Scatter diagrams of the permuted, or bit-reversed, index j versus the in¬ 
dex i for N = 4, 8,16, ... showing that each diagram is like a crystal 
formed by replicating cells that contain a kite (N = 4) or a frog (N = 8). 



B TABLE 12.4 

Pseudocode for a fast Hartley subprogram in which N is a power of 4. 


FAST HARTLEY TRANSFORM TO RADIX 4 
SUB "FHTradix4" (F(),P) 

N=4 A P 
N4=N/4 
R=SQR(2) 

Permute to radix 

J=1 

1=0 

a: 1=1+1 

IF I>=J THEN GOTO b 
T=F(J-l) 

F(J-l)=F(1-1) 

F(I-l)=T 
b: K=N4 

c; IF 3*K>=J THEN GOTO d 

J=J-3*K 

K=K/4 

GOTO C 

d: J=J+K 

IF I<N-1 THEN GOTO a 

Get DHT 
Stage 1 

FOR 1=0 TO N-l STEP 4 
Tl=F(I)+F(I+1) 

T2=F(I)-F(I+1) 

T3=F(I+2)+F(I+3) 

T4=F(I+2)-F(I+3) 

F(I)=T1+T3 
F(1+1)=Tl-T3 
F(I+2)=T2+T4 
F(1+3)=T2-T4 
NEXT I 

Stages 2 to P 

FOR L=2 TO P 
El=2 A (L+L-3) 

E2=E1+E1 

E3-E2+E1 

E4=E3+E1 

E5=E4+E1 

E6=E5+E1 

E7=E6+E1 

E8-E7+E1 

FOR J=0 TO N-l STEP E8 
T1=F(J)+F(J+E2) 
T2=F(J)-F(J+E2) 

T3=F{J+E4)+F(J+E6) 

T4=F(J+E4)-F(J+E6) 

F(J)=T1+T3 
F(J+E2)=T1-T3 
F(J+E4)=T2+T4 
F(J+E6)=T2-T4 
Tl=F(J+El) 


T2=F(J+E3)*R 
T3=F(J+E5) 

T4=F(J+E7)*R 
F(J+El)=T1+T2+T3 
F(J+E3)=Tl-T3+T4 
4 F(J+E5)=T1-T2+T3 

F(J-E7)=Tl-T3-T4 
FOR K=1 TO El-1 
L1=J+K 
L2=Ll+E2 
L3=L1+E4 
L4=L1+E6 
L5=J+E2-K 
L6=L5+E2 
L7=L5+E4 
L8=L5+E6 
Al=PI*K/E4 
A2=Al+Al 

A3=A1+A2 
C1=C0S(Al) 

Sl=SIN(Al) 

C2=COS(A2) 

S2=SIN(A2) 

C3=COS(A3) 

S3=SIN(A3) 

T5=F(L2)*C1+F(L6)* SI 
T6=F(L3) *C2+F(L7)* S2 
T7=F(L4)*C3+F(L8)*S3 
T8=F(L6)*C1-F(L2)*S1 
T9=F(L7)*C2-F(L3)*S2 
T0=F(L8)*C3-F(L4)*S3 
Tl=F(L5)-T9 
T2=F(L5)+T9 
T3=-T8-T0 
T4=T5-T7 
F(L5)=T1+T4 
F(L6)=T2+T3 
F(L7)=T1-T4 
F(L8)=T2-T3 
Tl=F(Ll)+T6 
T2=F(L1)-T6 
T3-T8-T0 
T4=T5+T7 
F(L1)*T1+T4 
F(L2)=T2+T3 
F(L3)=T1-T4 
F(L4)=T2-T3 
NEXT K 
NEXT J 
NEXT L 
SUBEND 
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which calls for swapping two pairs 1^4 and 3^6. These trivial swaps are then 
simply replicated over all the cells with no further operations than shifts. For a 
program see Brace well (1986) and for other papers developing the approach see 
Evans (1987) and Walker (1990). 


A FAST HARTLEY SUBROUTINE 

As the speed of central processing units has increased year by year the benefit of 
small improvements in the speed of programs has diminished. However, a 
radix-4 algorithm that saves around 25 percent of the running time can be rec¬ 
ommended when efficiency is important. Restrict data lengths to powers of 4 (16, 
64, 256, 1024, 4096, - ■ ■) and append zeros to data sets as needed. The following 
pseudocode appeared in Bracewell (1995) and is published with the permission 
of the American Institute of Physics. 

Methods of combining radix-2 with radix-4 algorithms to gain a speed ad¬ 
vantage are available (Pei and Wu, 1986; Bracewell, 1987). For very long data sets, 
parallel processing using a vector Hartley transform has been considered (Vil¬ 
lasenor and Bracewell, 1989) and found attractive as compared with correspond¬ 
ing procedures for getting the FFT on a multiprocessor machine. 

Short code segments elsewhere in this book are intended to be explanatory, 
but this subroutine is presented as a tool for spectral analysis. The pseudocode 
chooses expressions on the left rather than the examples on the right on the ba¬ 
sis of which is intelligible to more readers. 

FOR K = 0 TO N-l STEP 4 FOR K = 1:4:N 

NEXT K NEXT or ENDFOR or END 

K < N (K .LT. N) 

When time is of the essence it seems wasteful to work around GOTO statements 
knowing that the compiler will convert the resulting indirect code back to in¬ 
structions to transfer execution in just the way that the high-level GOTO specified. 
GOTO forms part of C, FORTRAN, and PASCAL, but not MATLAB. However the 
permutation segment in the pseudocode subroutine can be purged of GOTOs as fol¬ 
lows, for a sequence F ( ) indexed from 1 to N (kindly supplied by John E. Baron). 

J * 1; 

1 = 0 ; 

while (1 < N - 1), 

1 = 1 + 1 ; 
if (I < J), 

T = F(J) ; 

F (J) = F(X); 

F(I) = T; 
end; 
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K = N4; 

while (3 * K < J), 

J = j - 3 * K; 

K = K / 4; 

end; 

J = J + K; 
end; 

For fast operation, the pseudocode can be rewritten in C or in an assembler 
language. For easy immediate access to Hartley transforms, use an available FFT 
package and subtract the imaginary parts from the real parts using only half of 
the complex values generated. 
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PROBLEMS 

1. Obtain the DHTs of the following sequences: {1 2}, {1 2 3 4}, {1 2 3 4 5 6 7 8}. 

2. (a) From the previous results guess a rule about the occurrence of a zero element in the 

DHTof {12 3 ... 2 P }. 

( b ) Is your rule true for P = 4? 

(c) Prove algebraically that the DHT of {1 2 3 ... 2 P } always has one term that is zero. 

3. Obtain the DHTs of the following sequences: {2 1}, {4 3 2 1}, {8 7 6 5 4 3 2 1}. 

4. (a) Obtain the DFT of {8 7654321} from the DHT. (b) Deduce the power spectrum of 

{8 7654321} directly from the DHT. 

5. Obtain the DHTs of {2 3 4 5 6 7 8 1} and {3 4 5 6 7 8 1 2}. 

6. (a) Deduce the DFT of (3 4 5 6 7 8 1 2} from the DHT. 

(b) Deduce the power spectrum of {3 4 5 6 7 8 1 2} directly from the DHT. 

7. Obtain the DHTs of {7 6 5 4 3 2 1 8} and {6 5 4 3 2 1 8 7}. 

8. Obtain the DHT of {1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4}. 

9. (a) Obtain the DHTs of (1 2 1 2 1 2 1 2} and {1 1 2 1 1 2 1 1}. 

(b) Explain why the peaks fall where they do. 

10. (a) Obtain the DHT of {—2 2 —2 2 —2 2 —2 2} and explain the structure of 

the DHT. 

( b ) Obtain the power spectrum and explain the structure. > 

11. New use for cas function. Make a polar coordinate plot of r = [cas(0 mod { 77 )]”’, for 

0 6 =S 277. > 

12. Cyclic transforms. Show that application of the Fourier transform four times in suc¬ 
cession recovers the original function, i.e., that S i 3'3’3’f(x) = f(x), and that for the Hart¬ 
ley transform 30£/(x) - f(x). t> 

13. Discrete cosine transform. Taking N = 8, graph the basis functions versus t, for 
v = 0,1,2,3 and for v = 7, for each of the discrete transforms DCT1 and DCT2. Select 
a pair of basis functions and check whether the sum of the products is zero. t> 

14. Inserted zeros. Obtain the DFTs for the following sequences and point out any notice¬ 
able interrelationships. 

{2 718 2818 0000 000 0}, {0 000 2718 2818 000 0}, {2 000 0000 
0818 2817}. 

15. Integer data. Under what condition will a sequence of eight integers have a DHT con¬ 
sisting of integers only? 
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16. Binomial sequences. Comment on the DHTs of the following sequences. 

{17 2135 35 21 7 1}, {35 35 21 7 1 1 7 21}, {1 8 28 56 70 56 28 8 1}, {70 56 28 8 
1 1 8 28 56}. 

17. Random binary data. A sequence consists of N randomly chosen values 1 or — 1. (a) 
What are the expected values of H(0) and H(N/2)? (b) What would you expect for the 
standard deviation of H(0) if values were computed for a substantial number of such 
sequences? 

18. Accuracy of discrete transform. Cain some numerical intuition by comparing the DHT 
of {8 765 4321 0000 0000 0123 456 7} with 24 equispaced values of 
(8/3)sinc 2 (r/3). 

19. Sum of two angles. Show that 

cas(A + B) = cas A cas B + cas' A sin B. 


20. Derivative theorem. If V(t) has Hartley transform H(/), what is the Hartley transform 

ofV"(t)?> 


21. Hartley intensity. The Hartley intensity [H(u,v)] 2 of a shifted impulse S(x - a, y - b) is 
seen to consist of parallel fringes running from WNW to SSE. The fringe crest that 
passes nearest to the origin does so in the first quadrant and the fringe period is d. What 
is the exact location (a, b) of the original impulse? t> 

22. Complex Hartley plane. Show that the complex plane whose real axis is H(v) and 
imaginary axis H(-v) is related to the complex Fourier phase by a -45° rotation and 
magnification by V2. In other words 

H{v) 4- iH(-v) = (F real + iF imag ) x V2 trl*. > 

23. Fourier phase. Show that the Fourier phase <f> = arctan (F imag / F real ) is deducible directly 
from the Hartley transform without reference to the complex Fourier transform at all 
by = arctan[ H(—v)/H(v)] - tt/A. [> 


24. Affine theorem. The affine transformation in two dimensions (Bracewell, 1993) states 
that if f(x,y) 2 D H(u,v ) then 


f(ax + by + c, dx + ey + /) 2 d 


where 


eu — dv -bit + av 

a = -—, /3 =-—, and 6 = 


H(a,/3)cos 0 — H(—a,— /3)sin 0 
\ae — bd\ 

2tt\ (ec — bf)/u + [af — cd)/v] 


ae - bd ae — bd ae - bd 

Many of the Hartley transform theorems are special cases. Show that the rotation 
theorem is a special case of the affine theorem [> 


25. Convolution by DCT. Hubert Smith, MD, and Dy Jones, MS, work as programmers 
in a small medical instrumentation company. Smith says, "I want to convolve using 
the DCT, but I am too busy to do the algebra. I know that the DCT of a convolution is 
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K times the product of the DCTs and I know that {4 3 21} has DCT 
{5.0000 2.2304 0 0.1585} and that {2 3 5 7} has DCT {8.5000 -3.8076 0.5000 -0.0464}. 
Do you think this will give me K?" 

Jones says, "Shouldn't you avoid cyclic overlap by starting with {123400 0} and 
{235700 0}?" What value of K did these workers arrive at, and what advice do you 
have for them? 

26. Checking the DCT numerically. Discrete Hartley transforms can be checked numeri¬ 
cally by seeing that the initial element H(0) is the mean, or d.c., value of the data. Con¬ 
versely, the inverse transformation can be checked by comparing/(0) with the sum of 
the DHT values. The same is true of the DFT, taking into account that the values are 
complex. When it comes to checking the discrete transform we note that the DCT2 of 
{12 3 4} is {1.77 —0.79 0 —0.06} and that n F(0) is neither the sum nor the mean of the 
values of /(r). What is the expression that checks n F(0)? Conversely, what property of 
tt F(v) can be used to check /(0)? 

Now noting that the DCT1 of /(r) = {1 2 3 4} is ’F c (^) = {4.03 2.14 0.85 -0.65}, 
what are the expressions for checking the leading elements of f(r) and u F c (v)? E> 
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Relatives of the Fourier Transform 


Many Of the linear transforms in common use have a direct connection with ei¬ 
ther the Fourier or the Laplace transform. The closest relationship is with the gen¬ 
eralizations of the Fourier transform to two or more dimensions, and with the 
Hankel transforms of the zero and higher orders, into which the multidimensional 
Fourier transforms degenerate under circumstances of symmetry. The Mellin 
transform is illuminated by previous study of the Laplace transform and is the 
tool by which the fundamental theory of Fourier kernels is constructed. Particu¬ 
larly impressive is the simplification of the Hilbert transform when it is studied 
by the Fourier transform, and finally there is the intimate relationship whereby 
the Abel, Fourier, and Hankel transformations, applied in succession, regenerate 
the original function. 

All these transforms are tabulated in two volumes by Erdelyi et al. (1954). The 
Radon transform (Deans, 1983) may be viewed as a generalization of the Abel 
transform where circular symmetry is dropped. The Abel-Fourier-Hankel cycle 
then generalizes to the projection-slice theorem, an important thinking tool for re¬ 
construction from projections, or inversion of the Radon transform. 


THE TWO-DIMENSIONAL FOURIER TRANSFORM 

The variable x may stand for some physical quantity such as time or frequency, 
which is essentially one-dimensional, or it may be the coordinate in a one¬ 
dimensional physical system such as a stretched string or an electrical transmis¬ 
sion line. However, in cases which are two dimensional—stretched membranes, 
antennas and arrays of antennas, lenses and diffraction gratings, pictures on tele¬ 
vision screens, and so on—more general formulas apply. 

A two-dimensional function f(x,y ) has a two-dimensional transform F(u,v), 
and between the two the following relations exist: 
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F(u,v) = f f /(x,y)e ,27 ^ ux+ ^ dx dy 

J -oo J OO 

f(x,y) = [ [ F(u,v)e' 2 ^ ux +vy ) du dv. 

J -oo J —OO 

These equations describe an analysis of the two-dimensional function f{x,y) 
into components of the form exp [i27r(ux + vy)). Since any such component can 
be split into cosine and sine parts, we may begin by considering a cosine com¬ 
ponent cos [27r(ux + vy)]. 

As an example of a two-dimensional function consider the height of the 
ground at the geographical point {x,y), for example, over the area occupied by the 
mountain which is conventionally represented in Fig. 13.1 by contours of constant 
height. The function cos [27r(ux + vy)) represents a cosinusoidally corrugated 
land surface whose contours of constant height coincide with lines whose equa¬ 
tion is 

ux + vy = const. 

The corrugations face in a direction that makes an angle arctan ( v/u ) with the x 
axis and their wavelength is (w 2 + u 2 ) -5 . If a section is made through the corru¬ 
gations, in the x direction, it will undulate with a frequency of u cycles per unit 
of x. Similarly, v may be interpreted as the number of cycles per unit of y, in the 
y direction. 

In Fig. 13.1, a prominent Fourier component of the mountain is shown. In the 
transform domain the complex component is characterized in wavelength and 
orientation by the point ( u,v ) in the uv plane and its amplitude by F(u,v). The in¬ 
terpretation of u and v as spatial frequencies is emphasized by dimensioning u~ l 
and iT 1 , the wavelengths of sections taken in the x and y directions, respectively 
(see Fig. 13.1). The second of the Fourier relations quoted above asserts that a 
summation of corrugations of appropriate wavelengths and orientations, taken 
with suitable amplitudes, can reproduce the original mountain. The sinusoidal 
components, which must also be included, allow for the possibility that the cor¬ 
rugations may have to be slid into appropriate spatial phases. 



Fig. 13.1 A mountain (left) and a prominent Fourier component thereof (right). 
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Fig. 13.2 Expressing a two-dimensional function as 
tion. 




TWO-DIMENSIONAL CONVOLUTION 


The convolution integral of two two-dimensional functions f{x,y) and g{x,y) is de¬ 
fined by 

f oo f oo 

f**g=\ f(x',y')g(x - x',y - y')dx' dy'. 

Thus one of the functions is rotated half a turn about the origin by reversing the 
sign of both x and y, displaced, and multiplied with the other function, and the 
product is then integrated to obtain the value of the convolution integral for that 
particular displacement. 

The two-dimensional autocorrelation function is formed in the same way save 
that the sign reversal is omitted; thus 

Too Too 

f* + g=\ /(*>')£(* + x '> y + y') dx ' d y'- 

J — oo J —oo 


It is often convenient to be able to perceive ways in which a given function 
can be expressed as a convolution. For example, the two-dimensional function 



\x\ and |y| < \ 
elsewhere 


may be expressed as a product or as a convolution: 

2 n(x,y) = n(*)n(y) = [n(*)%)] * [n( y ) $(*)]. 

These two possibilities are illustrated in Fig. 13.2. 
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■ TABLE 13.1 

Theorems for the two-dimensional Fourier transform 


Theorem 

f(x,y) 

F(u,v) 

Similarity 

f(ax,by) 

J- f(--) 

\ab\ \a'bj 

Addition 

f(x,y) + g(x,y) 

F(u,v) + C(u,v) 

Shift 

f(x ~ a, y - b) 

e' 2v * M+bv >F(u,v) 

Modulation 

f(x,y) cos wx 

’ F (“ + £ u ) +iF ( u 

Convolution 

f{x,y) * g(x,y) 

F(u,v)G(u,v) 

Autocorrelation 

f{x,y) * /*(-*, -y) 

\F(u,v)\ 2 

Rayleigh 

1 \f(x,y)\ 2 dxdy = 

J -OO J -oo J -oo . 

[ \F(u,v)\ 2 du dv 

1 -oo 

Power 

f 00 f oo 

f(x,y)g*{x,y) dx dy = 

J —oo J —oo 

(oo (oo 

i F(u,v)G*(u,v) du dv 

J -oo J -oo 

Parseval 

jlj j!j l/(^y)l 2 = 



where F{u,v) = 2S a mn[ 2 ^{u - m,v - «)] 

Differentiation 

( 0(0 

{2mu) n {2TrivfF(u,v) 


~ f(x,y) = f'x{x,y) 

2viuF(u,v) 


^/foy) = f'yix.y) 

2irivF(u,v) 


a 2 

■^2 f(x,y) ~ fxx(x,y) 

—4tt 2 u 2 F(u,v) 


d 7 

-. 2 fM ~ f y 
d y 

-47t 2 u 2 F(m,u) 


- «**> 

—4tt 2 uvF(u,v) 


(£ + 

-47 t\u 2 + v 2 )F(u,v) 


The theorems pertaining to the one-dimensional transform generalize read¬ 
ily, as shown briefly in Table 13.1. 

Some theorems that come into existence in two dimensions are as follows. 

Rotation theorem. If f(x,y ) is rotated on the (x,y)-plane then its transform is ro¬ 
tated on the (u,y)-plane through the same angle and in the same sense: 

f(x cos 8 - y sin 6,x sin 8 + y cos 0)has2-DFTF(w cos 6 - v sin 8, u sin 8 + v cos 8). 
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■ TABLE 13.1 

Theorems for the two-dimensional Fourier transform (cont.) 

Theorem fix.y) F(u,v) 


Definite integral 
First moments 


Center of gravity 


Second moments 


Equivalent width 


f oo f OO 

J-oo J - dX dy = 

n * */ - f w> 

Too f oo 

I (x cos 8 + y sin 8)f(x,y) dx dy 

J —OO J oo 


KW) 


—2m 
F' v ( 0,0) 


f cos 8 F' u (0,0) + sin 8 F'^0,0)] 


(x) = 

X ' ~2mF(0,0) 

f OO f oo 

x l f{x,y) dx dy 

J — oo J —oo 

f°° F",,( 

foe foe 

J_ w }.J^ + /)/(^y) ^.¥ - [f uu(0/0) + F" u (0,0)] 

Too Too 

F(0,0) 


^ -2m F (0,0) 

FU 0 , 0 ) 

— 47T 2 

TOO) 


/( 0 , 0 ) 


Too foo 

F(u,v) du dv 

J -OO J -oo 


Finite differences! 


Running means 
Separable product 


A xf(x,y) 

A %f(x,y) 

A lxf(x,y) 



mm 


* my) 


i2 sin iTU F(u,v) 

-4 sin ttu sin m> F(u,v) 
— 4(sin ttu) 2 F(u,v) 

ab sine au sine bv F(u,v) 
F(u)G(v) 


+The finite differences in the table are defined as follows: 

A *f(x,y) = /(* + l y) - fix - i y) 

A xyf(x,y) — f(x + 2 , y + 2) ~ f{x — 2/ y + 2) ~ f( x + |/ y — 5) + f{x — y — |) 
A2 xxf(x,y) = f(x + l,y) - 2f(x,y) + f(x - 1 ,y). 


Simple shear theorem. If f(x,y) is subjected to shear then its transform is sheared 
to the same degree in the perpendicular direction: 

f(x + by, y) has 2-D FT F(u, v — bu). 

Affine theorem. A function f(x,y) subjected to an affine transformation of its coor¬ 
dinate plane, becomes (Bracewell et al., 1993; Bracewell, 1994) f(ax + by + c, 
dx + ey + /) and then has 2-D FT \ae - bd\~ l exp{i27r(ae - bd)~ l [(ec - 
bf)u + (af - cd)v]}F[(eu - dv)/(ae - bd), (-bu + av)/(ae - bd)]. 

Figure 13.3 illustrates a number of two-dimensional Fourier transforms. 
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Fig. 13.3 Some two-dimensional Fourier transforms. 



THE HANKEL TRANSFORM 

Two-dimensional systems may often show circular symmetry; for example, opti¬ 
cal systems are often constructed from components that, in themselves, are cir¬ 
cularly symmetrical. Then again, waves spreading out in two dimensions from a 
source of energy exhibit symmetry for natural reasons. It may be expected that in 
these cases a simplification will result, for one radial variable will suffice in place 



336 


The Fourier Transform and Its Applications 


of the two independent variables x and y. The appropriate expression of such 
problems is in terms of the Hankel transform, a one-dimensional transform with 
Bessel function kernel. 

When circular symmetry exists, that is, when 

f{x,y) = f (r), 

where r 2 = x 2 + y 2 , 

then F(u,v) proves also to be circularly symmetrical; that is, 

F(u,v) = F (q), 

where q 2 = u 2 + v 2 . 

To show this, change the transform formula to polar coordinates and integrate 
over the angular variable. 1 Then the relations between the two one-dimensional 
functions f(r) and F(<j) are 

%) = 2nj o ((r)J 0 (2irqr)r dr 

and Hr) = 2 tt J q F(q)J 0 (27rqr)q dq. 

We refer to F(g) as the Hankel transform (of zero order) of f (r) and note that 
the transformation is strictly reciprocal, as was the case when the kernels were 
cos and sin. The kernel / 0 , together with cos, sin, and others, is referred to as 
a Fourier kernel in the broad sense of a kernel associated with a reciprocal 
transform. 

The factors 2tt in the above formulas may be canceled by suitable redefini¬ 
tion of the variables, but their retention follows logically from the form adopted 
for Fourier transforms. In physical situations the 27r in parentheses will be found 
to result from the measurement of q in whole cycles per unit of r. The 27 t before 
the integral sign comes from the element of area 27rr dr. 


[°° [°° f(x,y)e- a <™ + ^ dx dy = [°° f 2 "f(r>r a ^ co ‘P-*V<Jrd0 

J —co J -oo JO JO 

= 27r Jj°f( r )/o( 2 m ?r)r dr 

rtf 6 , u + iv = qe 1 * and we have used the relation 


1 That is. 


where x + iy = 
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A number of zero-order Hankel transforms are shown as two-dimensional 
Fourier transforms in Fig. 13.4. Table 13.2 lists various Hankel transforms for ref¬ 
erence. 

Many of the theorems for the two-dimensional Fourier transform can be re¬ 
stated in terms of the Hankel transform. The names of the corresponding Fourier 
theorems are listed in Table 13.3 to allow comparison. 

Numerical evaluation of the Hankel transform is straightforward if the J 0 
Bessel function is available. An alternative method is to obtain the Abel transform 
f A (x) for nonnegative x, turn it into an even function of double length by sup¬ 
plying values for negative x, and call a fast Fourier transform. 

For aspects of the Hankel and two-dimensional Fourier transforms related to 
imaging see Bracewell (1995). 









Fig. 13.4 Some zero-order Hankel transforms shown as two-dimensional Fourier 
transforms. 
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□I TABLE 13.2 

Some Hankel transforms 


Hr) 


F(fl) 

n (£) 

a Ji(2vaq) 


sin 27 toy 

n (<?/2fl) 


r 

(a 2 - ^ 


\ S(r - a) 

7raJ 0 (27raq) 


M(arY 

a ~ 2f 0 


e~ w 



1 

e ~2 muf 


(a 7 + 



1 

2ire~ 2 ™i 


(fl 2 + T 2 ^ 

a 


1 



a 2 + r 2 

2vK 0 (2TTaq) 


2a 2 



(« 2 + r 7 f 

47T 2 aqK ^2-TTaq) 


4 a 4 



(a 2 + r 2 ) 3 

47r 2 aqK l (27raq) 

+ 4'ir 3 a 2 q 2 K 0 (27raq ) 

^ ' 
1 

To 

i>|*t 

a 7 l 2 (2iTuq) 



Trq 


1 

1 


r 

<? 


e ~ar 

2va 



(47r 2 ^ 2 + a 2 )^ 


e -or 

277 


r 

(47t 2 ^ 2 + a 2 )' 


8(r) , 



—~r = K*,y) 

ITT 

1 




[/ i ( 2 ™< 7)] 2 

V 


-47r 2 r 2 /(r) 

(d 2 F 1 df\ . 

W + q dq) ~ V F 

r 7 e~' rr> 

(i" 4 " 

/o(27r«r) 

7T 2 <? V 2 - q 2 ) I/2 ]n(7rg/2) 

jinc ar 

a 2 n(g/a) 

jinc 2 ar 

5 [cos 1 q -q(1 - q 2 ) l ^U{q/2)] 

sine 2 ar 

( 77 a 2 ) 1 cosh ’(a/q) 

r~ln(r) 

e* 

2tt( 1 - 47r 2 fl 2 ) n - 1 n(77/ ? )/2"- , (n - 1)! 


tin this table M(x) 


= 27t[jc- 3 [* 
J° 


loix) dx - x 2 } 0 (x) 
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■ TABLE 13.3 

Theorems for the Hankel transform 


Theorem 

f(r) 

F (q) 

Similarity 

f(«r) 


Addition 

fir) + g(r) 

m + G(q) 

Shift 

Shift of origin destroys circular symmetry 


Convolution 

j o 00 | o 27, f(r')g(R) r ' dr' de 

F(q)G(q) 


{R 2 = r 2 + r' 2 - 2 rr' cos 0) 


Rayleigh 

| 0 |f( r )| 2 r dr = J° \F{q)\ 2 q dq 


Power 

Too f oo 

J 0 f (r)g*(r)rdr = J o F(q)G*(q)qdq 


Differentiation 

Exercise for student 


Definite integral 

Zir L f i r ) rdr= p (°) 


Second moment 

foe F"(0) 

2tt r 2 i(r)rdr = —H; 

Jo V > - 2 tt 7 


Equivalent width 

2tt | o °°f(r)rdr F(0) 

f(0) 277 | 0 F ifady 



FOURIER KERNELS 

Let two functions/and gbe related through the following integral equation whose 
kernel is k: 

f oo 

gi*) = J 0 f(x)k{s,x)dx, 

and let the kernel be such that a reciprocal relationship also holds; that is, 

fix) = j 0 £(s)/c(s,x) ds. 

We know that 2 cos lirax, 2 sin 2irax, and cas 2ttox are such kernels, and a 
whole further set is furnished by a theorem established by Hankel, namely 2 

Ki x ) = | 0 ds (xsfj„(xs) g{x)(xs)fXxs) dx, 


2 Where/(x) is discontinuous, the left-hand side should be replaced by |[/(x + 0) + /(x — 0)]. 
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whence G(s) = J o g(x)(xs)^f t ,( xs ) dx, 

and conversely, g(x) = G(s)(xs)‘/„(xs) ds. 

By splitting off a factor s^ from G(s) and x* from g(x), that is, by putting 
G(s) = s^F(s) and g(x) = x'/(x), we obtain the following alternative expressions of 
the above formulas: 


f oo 

f (s) = ] 0 xf(x)J v (xs) dx 

/(*) = J 0 °° sF(s)J v (xs) ds. 

The case in which v — 0 was derived earlier from the two-dimensional Fourier 
transform under conditions of circular symmetry. 

It is interesting that by taking v — ± \ and using the relations 



we recover the known kernels 2 cos 2irax and 2 sin 27Tflx, which shows that the 
cosine and sine transform formulas are included in Hankel's theorem. 


THE THREE-DIMENSIONAL FOURIER TRANSFORM 


Undoubtedly physical systems have three dimensions, but for reasons of theo¬ 
retical tractability, one seeks simplifications. The classical example in which 
Fourier analysis in three dimensions has nevertheless had to be faced is the dif¬ 
fraction of X-rays by crystals. The formulas are 

F(u,v,w) = f [ [ f(x,y,z)e~ a '^ xu+yv+zw) dx dy dz 

J -OO J -oo J —OO 

/(x,y,z) = f f f F(u / v,wy 2 ^ ux+vy+wz) du dv div. 

J -OO J -OO J -oo 

Multidimensional transforms, should they be encountered, will be recog¬ 
nized without difficulty. By taking x and s to be vectors whose components are 
(x!,x 2 ,- •.) and (s 1 ,s 2 ,•■•), we have the following convenient vector notation for 
n-dimensional transforms: 

F(s) = j j • ■ • j°V(x)e ' 27rxs dx, dx 2 . ■ ■ dx„. 

In cylindrical coordinates r, 6, z where 
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x + iy = re* 6 , 

the three-dimensional transform may be expressed in terms of the transform vari¬ 
ables s, <f>, w, where 

u + iv = sef*. 


by the formulas 


= J" | TO g{r,8,z)e a ^ sr cos (e “ ^ + “V dr dd dz 
g{r,8,z) = [“ f 2 " f °° G(s,t}>,wY 2 ^ r (e '* )+K ^ ds d<f> dw. 

JO J0 J -oo 


These results are derivable directly from the basic formulas by substituting 

g(rM = f(x,yj) 

and G(s,<f),iv) = F(u,v,w). 

Under circular symmetry, that is, when /is independent of 6 (and hence F in¬ 
dependent of <}>), we find by writing 

h(r,z) = f{x,y,z) 

and H(s,zv) ~ F(u,v,w) 

that H(s,w) = 27r [ [ h(r,z)J 0 (27rsr)e t27TWZ r dr dz 

Jo J -00 

f oo f oo 

h(r,z) = 277 H(s,w)f 0 (27rsr)^ 2vwz s ds dw. 

JO J -oo 

To obtain this result we use the formula derived earlier for the Hankel transform 
of zero order. 

Under cylindrical symmetry, that is, when / is independent of both 6 and z, 
being a function of r only, say f{x,y,z) — k(r) and F(u,v,w) — K(s,w), then 

K(s,w) = K(s) 8(w), 

where K(s) = 2tt k(r)/ 0 (27rsr)r dr. 


In spherical coordinates r,8,<f>, with transform variables s,0,<J>, we have 

x = r sin 6 cos $ y = r sin 0 sin </> z = r cos 6 

u = s sin 0 cos <J> v - s sin 0 sin $ w = s cos 0. 

Writing f(x,y,z) = g{r,6,(f>) and F(u,v,w) = G(s,0,<J>), we find 

C(s,0,<D) = j 0 " J * \ 2 ”g(r,8,(f>y~‘ 2nsr[cos e cos0+s,>,esme cos sin 8 dr d8 d<f>. 


g(r,6,4>) = J* jj G(s,0,$y 7 ^ cos ° cos e+ sin e sm e cos sin 0 ds dO d<f>. 
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With circular symmetry, that is, when f(x,y,z) is independent of <f>, we have, writ¬ 
ing f{x>y> z ) = h ( r > 6 ) and F(u,v,iv) = H(s,0), 

H(s,0) = 2tt h(r,0)J o (2irsr sin © sin d]e~ airsr «* e «. sin edrde 

With spherical symmetry, we have, writing f{x,yz) = k(r ) and 

F(u,v,w ) - K(s), 

K(s ) = 4n j o k(r) sine (2sr) r 2 dr, 
k(r) = 4 tt K(s) sine (2sr) s 2 ds. 

A few examples of three-dimensional Fourier transforms are given in Table 13.4. 
Many more can be generated by noting that 

f(x)g(y)h(z) D F(u)G(v)H(xv), 

where f(x), F(u), and the like are one-dimensional Fourier transform pairs. This 
result is proved by expressing f{x)g(y)h(z) in the form 

/(*) s (y) 5 ( z ) * 5 (%(y) 5 (z) * 5 (z) 8(y)h(z) 


■ TABLE 13.4 

Some three-dimensional Fourier transformst 


f(x,y,z) 


F(u,v,w) 

3 S(x - a, y — b,z - c) 

point 

gi2Tr{au+bv+clv) 

g-^xV^+yVb’+^/c 2 ) 

Gaussian 

abce _,r( ‘ ,v+f ^ 2+c2w! ^ 

3 H (x,y,z) 

cube 

sine u sine v sine tv 

2 H (x,y) 

bar 

sine u sine v 6 (h;) 

U(x) 

slab 

sine u S(v) S(tv) 

nwn[(/ + z 2 )^] 

disk 

JiM®* + a^) 1 ] 

sine u -;— 

2(1^ + utf 

"(0 

ball 

sin 27rs — 2vs cos 2tt$ 

27T 2 S 3 

(i - kl)n(0 


it 12 2(1 — cos 27rs) — 2 tts sin 2irs 

3 (27t) 4 s 4 

a - ^)n(l) 

e-r/K 


877 [3 — {2.TTsf] sin 27 ts — 3(2irs) cos 2tts 
(2'w) 5 s 5 

6 

IttR 3 


(1 + 47r 2 R 2 s 2 ) 2 
e~ m ' 


f In this table r 2 = x 2 + y 2 + z 2 and s 2 = m 2 + t? + w 2 . 
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and then applying the convolution theorem in three dimensions. As various cases 
of this kind we have 


f( x )g(y)K z ) F(u)G(v)H(w) 
f( x )g(y) => F(u)G(v) 8{zv) 
/(x) D F(u) 8(v) 8(zv) 
k (r)h(z) D K(s)H(w) 
k(r) D K(s) 8(w) 


THE HANKEL TRANSFORM IN n DIMENSIONS 

When symmetry in n dimensions exists, the resulting one-dimensional transform 
is 

&(<}) = { ~ f( r )j\n - 1 ( 2 ^)^" ^ . 

By putting n = 1,2,3, we recover the Fourier and Hankel transforms and the 
case of spherical symmetry previously stated (bearing in mind that 
/j(x) = (2/ ttx)* sin x and J_i(x) = {2/irx'f cos x). 


THE MELLIN TRANSFORM 

The transform defined for complex s by 

F m (s) = jj/CxJx 5-1 dx 

proves to be equivalent to the Laplace transform (Chapter 14) when a simple 
change of variable is made. Putting 

x = e~‘ 

we have dx = -e~ 1 dt 

x*-i = e -Ks-i) f 

[ 00 

whence F M (s) = f(e~‘)e~ st dt. 

) -oo 

The Laplace transform of the t functions, and the Mellin transform of the 
x function, shown in Fig. 13.5, are the same. When we replot a function of time 
as a function of we compress all positive time into the range from 1 to 0. 
Several Mellin transforms are listed in Table 13.5. 

The inversion formula for the Mellin transform is 

1 f c + ioo 

/(*)=T- • fM00x- s ds. 

2m jc—ioo 
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GW 




Fig. 13.5 Relation between Mellin and Laplace transforms. 


Just as the Laplace transform approaches the Fourier series as a special case when 
the nonzero parts of F L (s) concentrate around imaginary integral values of s, so 
is the Mellin transform related to power series. 

We may regard F M (s ) as the (s — l)th moment of f(x). For example, if 
/(x) = Il(x — 2 ), then F M (s) = s -1 (provided Re s is positive). This Mellin trans¬ 
form pair is illustrated in Fig. 13.6. In general. 


Area of /(x) 

First moment of /(x) 
Second moment of /(x) 

Abscissa of centroid, (x) 
Radius of gyration 


= f M (l) 

= Fm(2) 
= f m(3) 
F m (2) 




Fm( 1) 


Fm(3)1 


Second moment about centroid = F M (3) — 


[Fm(2)] 

F m (1) 


2 



/(*) 






«—<x>—►] 

Jt 



Fig. 13.6 


Mellin transform pair. 
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■ TABLE 13.5 

Some Mellin transforms 


f(x) 

Fm(*> 


Convergence 

condition 

8(x - a) 

fl 5 1 



H(x — a) 

s 



H(a — x) 

0 s 

s 



x"H(x - a) 

s + n 



x n H(a - x) 

cf +n 

s + n 



e ax 

fl -T( S ) 


Re a > 0, Re s > 0 

e~* 

mb) 



sin x 

T(s) sin 2 ^rs 


-1 < Res < 1 

cos X 

T(S) COS J77S 


0 < Re s < 1 

1 

1 + X 

77 cosec 77S 



1 

1 - x 

77 COt 77S 



1 

r(s)r(a - s) 


Rea > 0 

(! + *)■ 

m 


1 

1 +r 2 

y 7 cosec J77S 



(i - xy-'H (i - x ) 

r(s)r (a) 

T(s + a) 


Rea > 0 

(:x - 1 ) a H(x - 1) 

r(a - s)r(i - 
F(1 - 5) 

«) 

0 < Re a < 1 

In (1 + x) 

77 

— cosec 7TS 
s 


-1 < Res < 0 

\tt - tan -1 x 

|77S _1 sec 




( 2(2 S - 1) 

s ^ 0 

s — 0 


A(x - 1) 

\ s(s + 1) 
Uln2 

Res > —1 

erfc x 

n\s + 1) 

7T 2 S 


Res > 0 

Six 

I’(s) sin |7rs 

s 

-1 < Res < 0 
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■ TABLE 13.6 

Theorems for the Mellin transform 


fix) 

F^is) 

f{ax) 

« *F m (s) 

a > 0 

h+h 

F\m + Fim 


xf(x) 

Fm{s + 1) 



f m(s + a) 



Fm(s) 


fix') 

‘MS 

a > 0 

fix-') 

-M-t) 

a > 0 

fix) 

-(s - 1)F M (s - 

1) 

xf'(x) 

~sF m (s) 


x'f'(x) 

~(s + a - 1 )F m (s + a _1 ) 

fix) 

(s - l)(s - 2)F m (s - 2) 

x 2 f H {x) 

s(s + 1 )F m (s) 


f n \x) 

(-!)"(« -«)■•• 

(s - 1 )F m (s - n) 

i‘£) /w 

(-1)"s"F m (s) 



Fm( s )G m (s + 1) 


0{u) g{u)du 

Fm(s)G m (s) 


f(x)g(x) 

h!ZZ F{T)G{s - T)dT 


Theorems for the Mellin transform are listed in Table 13.6. These theorems 
are closely related to those discussed earlier in respect to Fourier transforms. 

By taking Mellin transforms of each of the equations 

#(«) = f(x)k(ctx) dx 
and f(x) = j~g(a)h(ax) da, 

the relation between the Mellin transforms K M (s) and H M (s) is found to be 

K m (s)H m ( 1 - s) = 1. 
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This relation leads to the solving kernel h(ax ) for integral equations with kernel 
k(ax) and also, when h(ax) — k(ax), leads to the condition for Fourier kernels of 
the form k(ax), namely, 

- s) = 1 . 


THE z TRANSFORM 

A good deal of interest attaches to signals whose sample values at equispaced in¬ 
tervals of time constitute the full available information about the signal. Such sig¬ 
nals arise in communications systems using pulse modulation, where several dif¬ 
ferent messages are interlaced on a time-sharing basis, and another important 
sphere of interest includes control systems in which feedback is applied on a ba¬ 
sis of samples, taken at regular intervals, of some quantity which is to be con¬ 
trolled. Many other examples come to mind, including topics involving proba¬ 
bility theory and periodic structures in space, but pulse modulation and 
sampled-data control systems are the main fields where the z transform is cus¬ 
tomarily introduced. 

It is usual to suppose that the time interval between samples is T, but here 
the interval will be taken to be unity. If it is necessary to deal with some other in¬ 
terval, one can always introduce a new independent variable differing by a suit¬ 
able factor. 

Let the function /(f) be known to us only through its sample values at 
f = 0,1,2, ..., n, namely, 

m /o) m • • •/("). 

Then the polynomial 

m=m + ft i)z-' + /(2) Z -* +... + ftn)z- 

is referred to as the z transform of /(f). The function /(f) is real and is taken to 
be zero for f < 0; the variable z is taken to be complex. 

The impulse string 

m = m m + m m* -1)+/o s(t-2) +... + /<«) s(t - n \ 

though quite different in character from the original function /(f), is fully equiv¬ 
alent to the set of samples, as has been pointed out in connection with the sam¬ 
pling theorem. In fact it is often convenient to deal directly with the sequence 

{/(0) /(l) /(2) ■ • • /(n)} 

without specifying the kind of signal. 

If such signals are applied to the input of a system whose impulse response 
is 


{M0) HI) M2) • • • h(n)}. 
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then the output of the system is represented by the serial product 

1/(0) /(I) /(2) • • • /(»)} * (MO) Ml) M2) • • • M«». 

But we have seen in Chapter 3 that the serial-product rule for convolving se¬ 
quences is the same as that for multiplying polynomials. Hence the z transform 
of the output is the product 

F(z)H(z), 

where H(z) is the z transform of the impulse response. 

For example, if a signal {2 1} is applied to a system whose impulse response 
is {8 4 2 1}, then 

F(z) = 2 + z' 1 

H(z) - 8 + 4z 1 + 2z~ 2 + z~ 3 

and the z transform of the output is given by 

F(z)/f(z) = (2 + z _1 )(8 + 4z‘‘ + 2z -2 + z~ 3 ) 

= 16 + 16z _1 + 8z~ 2 + 4z 3 + z~\ 

Hence the output sequence is 

{16 16 8 4 1}. 

Conversely, if the input and output are given and it is desired to find what 
impulse response the system must have, one simply divides the z transform of 
the output by the z transform of the input and expands the result as a polyno¬ 
mial in z" 1 . The coefficients then give the answer. 

Serial multiplication and its inversion, as introduced in Chapter 3, constitute 
an alternative and quite direct approach to the theory of such numerical prob¬ 
lems, and present the essential arithmetic of multiplying and dividing z trans¬ 
forms which remains when the numerous z's are omitted. 

The possibility of factoring polynomials entering into products or quotients 
makes for theoretical convenience of the z transform and allows one's familiarity 
with algebraic manipulation to be brought into play. For this reason, a table of z 
transforms of some common impulse signals is useful for reference. If the signal 
is specified by a sequence of numerical data, it is a trivial matter to write down 
the z transform. We consider here cases in which the strengths of the successive 
impulses are given by some simple formula instead of by actual data. Let 

m = m m + m m * - 1 ) + m - 2 ) +... + /(») m * - *)• 

Taking the Laplace transform of <f>(t) and calling it F L (p), we have 

Fl(p) = me- pt dt = §/(»)*"*■ 

j -°° n = 0 

This is a simple polynomial in exp (— p). Putting 

2 = <*, 
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we find F L (p) = ^f(n)z~ n , 

«=o 

but this polynomial is by definition the z transform of /(f). 

As an example, consider the sequence of pulses 8(f) + 8(f — 1) + 8(f — 2)- 

Its Laplace theorem is given by 1 + e~ v 4- e~ 2p -f ..., and its z transform is 
1 +■ 2- 1 + Z ~ 2 + . . . . Thus the z transform is directly deducible from the Laplace 
transform. In this case of a function specifiable by a simple formula rather than 
by data, the polynomial can be expressed in finite form, 

1 _1_ 

1 - e~ p ~ 1 - 

and makes a compact entry in Table 13.7 where z transforms are listed. 

Operations carried out on f(n ) will correspond with operations on the z trans¬ 
form; pairs of such operations are listed in Table 13.8. 

A comparison of this table with the theorems quoted for the Mellin transform 
will reveal that the two are virtually identical. This is because the Mellin trans¬ 
form and the inverse z transform are related to the Laplace transform in much 
the same way. Thus in the Laplace integral 

f" 

J —oo 

we put x — exp (—f) to derive the Mellin transform, while we put z = exp (— p) 
to derive the z transform. The three transforms and their inversion integrals are 
listed below for reference and comparison. 


FlOO = f“ /Me-* dt 

J — OO 


Fm(s) = j 0 /(*)**' 1 dx 

i f c+ ioo 

/(*) = -r—.\ . Fm(s)x' s ds 

2.TTI ic-tn o 


F( z) = f" 0(*)z-‘ dt 

J — oo 


00 

= 2/(»)*'" 


o 


It is clear that the z transform is like the inverse Mellin transform except that 
t must assume real values whereas s may be complex, and conversely, x is real 
whereas z may be complex. The contour T on the z plane may be understood as 
follows. It must enclose the poles of the integrand. If the contour c — ioo to c + io o 
for inverting the Laplace transformation is chosen to the right of all poles, then 
the circle into which it is transformed by the transformation z = exp (~p) will en¬ 
close all poles. In the common case where c = 0 is suitable (all poles of P L (p) in 
the left half-plane), the contour T becomes the circle \x\ = 1. 
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■ TABLE 13.7 

Some z transforms for algebraically specifiable signals 


{/<«>} 

/(«) 

F(z) 

{fl 0 fl 2 — } 

a n 

flo + fliZ -1 + a 2 z~ z + ... 

{1111...} 

1 

1 

1 -z -1 

{0111...} 


z -1 

1 - z -1 

{0123 ...} 

n 

z -1 

(1 - z -1 ) 2 

{0149 ...} 

n 2 

z -, (l + z -1 ) 

(1 - z -1 ) 3 

{018 27 ...} 

n 3 

3z -2 (l + z -1 ) z -1 (l + 2z -1 ) 

(1 - z -1 ) 4 ' (1 - z~'Y 

{1 e - ° e -2a ..} 

e~ m 

1 

1 - e - “z -1 

{01 - e - “l - e -2 " ...} 

1 - e~ an 

(1 - e - °)z -1 
(1 - z -1 )(l - e - “z -1 ) 

{0 e~ n 2e~ 7 " ...} 

tic - "” 

e -a z -1 

(1 - e - “z -1 ) 2 

{0 e~° 4e 20 ... } 

« 2 e -a " 

e -a z -1 (l + e -a z -1 ) 

(1 - e - "z -1 ) 3 


> - 1 + e~ a ") 
a 


z -1 _(1 - e - °)z -1 

(1 - z -1 ) 2 a(l - z -1 )(l - e - “z -1 ) 


(g~ a ~ e-^z- 1 
(1 - e - “z -1 )(l - e -f, z -1 ) 


sin an 

cos an 

sinh an 
cosh an 
e~“" cos ton 

e~ m sin a>n 


_ z -1 sin a _ 

1 - z -1 2 cos a + z -2 
1 - z -1 cos a 
1 — z -1 2 cos a + z~ 2 
z -1 sinh a 

1 - z -1 2cosha + z -2 
1 - z -1 cosh a 
1 - z -1 2 cosh a + z -2 
1 - z~ l e~ a cos to 
1 — z -1 2e -a cos (o + e~ 2a z~ 2 

_ z -1 e~ a sin to _ 

1 — z -1 2e"“ cos to + e -2 "z -2 


/(« + 1) zF(z) - /(0)z 

+ 2) z 2 F(z) - /(0)z 2 - /(l)z 

«*/(«) —z(d/dz)“F(z) 
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■ TABLE 13.8 

Theorems for the z transform 


fin) 

Ftz) 

/i(”) + fi{n) 

A(Z) + F 2 (z) 

f{n - 1) 

z-'F(z) 

/(« “ «) 

z~T(z) a s Of 

«/(”) 

-zF'(z) 

-(« - 1)/(« - 1) 

F'(z) 

«-"/(«) 

F(az ) a > 0 

/i(n) * / 2 (n) 

F\{z)F 2 (z) 


tThis restriction is a consequence of assuming 
f(n) to be zero for n < 0. 


THE ABEL TRANSFORM 


As soon as one goes beyond the one-dimensional applications of Fourier trans¬ 
forms and into optical-image formation, television-raster display, mapping by 
radar or passive detection, and so on, one encounters phenomena which invite 
the use of the Abel transform for their neatest treatment. These phenomena arise 
when circularly symmetrical distributions in two dimensions are projected in one 
dimension. A typical example is the electrical response of a television camera as 
it scans across a narrow line; another is the electrical response of a microdensito¬ 
meter whose slit scans over a circularly symmetrical density distribution on a pho¬ 
tographic plate. 

Fractional-order derivatives are also closely connected with the Abel trans¬ 
form, which therefore also arises in fields, such as conduction of heat in solids or 
transmission of electrical signals through cables, where fractional-order deriva¬ 
tives are encountered. 

The Abel transform f A [x) of the function f(r) is commonly defined as 


f CO 

/„(*>= 2 f, 


f(r)r dr 
(r 2 - x 


The choice of the symbols x and r is suggested by the many applications in which 
they represent an abscissa and a radius, respectively, in the same plane. 

The above formula may be written 


/<(*) = i ir. 


Hr.) = {jf ' ^ 


r > x 
r < x. 


where 
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The kernel k(r,x), regarded as a function of r in which x is a parameter, shifts to 
the right as x increases, and it also changes its form. A slight change of variable 
leads to a kernel which simply shifts without change of form. Thus putting £ = x 2 
and p = r 2 , and letting f A {x) - F A (x 2 ) and /(r) = F(r 2 ), we have 


r*(() = } 0 “k« - P)F(p)<fp, 

where 

m _ /(-«-* *<<> 

lo £ > 0 ; 

alternatively. 

F„(f>-f\ F(P) S 

>P (p - ft 

or again. 

f a = k*f. 

When necessary, F A will be referred to as the "modified Abel transform of F." 
Having reduced the formula to a convolution integral, we may take Fourier trans¬ 
forms and write 


f a = kf. 

Since 

m-, w 

(— 2js) 2 

it follows that 

F = (-2 isfF A 


— , ilirsF A 

* (-2 isy 

whence 

F = ~K * F A ; 

7 T 

that is. 

If ooF^df 

Hp)= „ \ 

77 }p (£ - pf 

The solution of the modified Abel integral equation enables F to be expressed 
in terms of the derivative of F A . Integrating the solution by parts, or choosing dif¬ 
ferent factors for the transform of F, we obtain a solution in terms of the second 
derivative of F A : 


F = —9C * Ft 

TT 

where 

= {o“^ 
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Since K is nowhere zero, the solution is unique (except for additive null func¬ 
tions). 

Reverting to/and f A , we may write the solutions as 




(x 2 -^ 


ld_ 

dx 


Ta(x)' 


dx, 


or, if the integral is zero beyond x — r 0 , and allowing for the possibility that the 
integrand may behave impulsively at Tq, we have 


1 K fk{x)dx 


fA.ro) 




and 


W ttL ' TT^-r^ 

7T J r V dx L X 

Useful relations for checking Abel transforms are 

= 2-Jr/Wr* 

fM = 2}“/(r)rfr. 


Another property is that 

K * K * F' = -7rF; 

that is, the operation K * applied twice in succession annuls differentiation; then 
F a is the half-order integral of F, and conversely, F is the half-order differential 
coefficient of F A . To prove this, note that if F A = K * F implies that 
F = —7r _1 K * F a , then it follows further that F' A = K * F'; whence 

K * K * F’ = K* F' a = -ttF. 

In Table 13.9 the first eight examples are to be taken as zero for r and x greater 
than a. 

Numerical evaluation of Abel transforms is comparatively simple in view 
of the possibility of conversion to a convolution integral. One first makes the 
change of variable, then evaluates sums of products of K(p) and /(£ — p) at dis¬ 
crete intervals of p. The values of K turn out to be the same, however fine an 
interval is chosen, save for a normalizing factor; consequently, a universal table 
of values (see Table 13.10) can be set up for permanent reference. The table 
shows coefficients for immediate use with values of F read off at p = \\, ■ ■ ■ , 9j, 
the scale of p being such that F becomes zero or negligible at p = 10. The table 

gives mean values of K over the intervals 0 - 1,1 - 2,-Thus at p = n + \ 

the value is 

j" +1 K(-p)dp = 2(n + 1)* - 2nk 
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■ TABLE 13.9 

Some Abel transforms 


fM 



/*<*> 


n(r/2fl) 

Disk 

2 (a 2 - x*)*n(x/2fl) 

Semiellipse 

(a 2 - r z ) _ ^n(r/2fl) 



7rn(r/2fl) 

Rectangle 

(a 2 - r 2 ) J n(r/2a) 

Hemisphere 

*7r(a 2 - x 2 )Y\(x/2a) 

Parabola 

(a 2 - i*)Y\{r/2a) 

Paraboloid 

V - x 2 )'n(x/2«) 


(a 2 - i*fn(r/2a) 



(3t r/8)(a 2 - r 2 ) 2 n(r/2fl) 


aA(r/a) 

Cone 

[^(a 2 - x 2 )* - x 2 cosh _1 (a/x)]n(x/2a) 


7T -1 cosh 1 (a/r)n(r/2a) 



aA(x/a) 

Triangle 

S(r - a) 

Ring impulse 

2a(a 2 - x 2 )^n(x/2tf) 


exp (-^/2o- 2 ) 

Gaussian 

{lirfcr exp (-x 2 /2cr 2 ) 

Gaussian 

r 2 exp (-r 2 /2<r 2 ) 



(27t)*o - (x 2 + cr 2 ) exp (—x 2 /2<r 2 ) 


(r 2 — tr 2 ) exp (—r z /2<r 2 ) 



(2'n-^o-x 2 exp (-x 2 /2<r 2 ) 


(a 2 + r*)" 1 



7r((2 2 + X 2 )^ 


/ 0 (27rflr) 



(Trfl)^ 1 COS 27TAX 


2 tt r 3 {'/ 0 (r )dr - r 2 / 0 (r) 

= M(r) 

sine 2 x 


5 (r)/7r|r| 



S(x) 


2a sine 2ar 



/o(27Tflx) 


|r _1 /i(27rar) 



sine 2ax 



■ TABLE 13.10 

Coefficients for performing or inverting 
the Abel transformation 


n 

K 

P 

K 

P 

K 

P 

K 


2.000 

5* 

0.427 

10* 

0.309 

15* 

0.254 

i* 

0.828 

4 

0.393 

11* 

0.295 

16* 

0.246 

2* 

0.636 

n 

0.364 

12* 

0.283 

17* 

0.239 

3* 

0.536 

% 

0.343 

13| 

0.272 

18* 

0.233 

4* 

0.472 

9* 

0.325 

14* 

0.263 

19* 

0.226 
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When N points of subdivision are used, the scale of p is arranged so that F 
becomes zero at p = N. The coefficients may then all be multiplied by (10/N) 5 , or 
the coefficients may be left unchanged and the answers multiplied by (10/N)*. 

As an example consider F(p) = (10 — pf, for which the modified Abel trans¬ 
form is known to be F A (€) = \tt(1 - £). We work at unit intervals and, visualiz¬ 
ing the algorithm as a manual procedure, copy the coefficients on a movable strip. 
The calculation in progress is shown in Fig. 13.7. The movable strip is in position 
for calculating F A (g ) as the sum of products of corresponding values of F and K: 

7.78 = 2.12 X 2.000 + 1.87 X 0.828 + -.. + 0.71 X 0.472. 

The inverse problem, that of calculating F from F A , can be handled by means 
of the relation F = -tt 1 K * F' A if F A is first differentiated. However, it will be 
perceived that the calculation just described can be done in reverse, using the val¬ 
ues of F a , and working the movable strip upward from the bottom. The strip is 
shown in position for calculating F(5 - \), let us say by means of a pocket calcu¬ 
lator. Form the products 0.71 X 0.472, . • •, 1.87 X 0.828, allowing them to accu¬ 
mulate in the memory. Subtract this sum of products from 7.78 and divide by 
2.000 to obtain the next wanted value, F(5 — |) = 2.12. 

These convolution procedures are readily programmable; an alternative ap¬ 
proach, sharing the virtue of avoiding the singularity as r approaches x, is as fol¬ 
lows. Set up a user-defined function FNf (r) using an algebraic expression or, if the 
radial function is available as data samples, make values of /(r) between samples 


1 

2 

3 

4 


3.08 

Z91 

2.74 

2.55 

235 


15.65 

14.08 

12.52 

10.94 

9.37 



Fig. 13.7 Calculating modified Abel transforms. 
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available by interpolation. Here is the program, based on N equispaced integer 
values of f(r) from 0 to N — 1. For higher precision, increase M. 

N=10 

M=10 

FOR i=0 TO N-l 
S=0.5*FNf(i/N) 

FOR j=l TO INT(M*SQR{N A 2-i A 2)) 
r=SQR(i A 2+(j/M) A 2)/N 
S=S+FNf(r) 

NEXT j 

PRINT l/N;FNr(2*s/N/M) 

NEXT i 


An example starting from /(r) 

= 1 - r 

gave these results. The mean 

absolute 

error is less than 10 5 . 







r 

0 .1 .2 

.3 

.4 

.5 

.6 

.7 .8 

.9 

fir) 

1 .9 .8 

.7 

.6 

.5 

.4 

.3 .2 

.1 

f A (x) 

1 .9651 .8881 

.7853 

.6658 

.5368 

.4045 

.2753 .1564 

.0575 


THE RADON TRANSFORM AND TOMOGRAPHY 

When a slit scans over a circularly symmetrical two-dimensional density distrib¬ 
ution on a photographic plate, generating a profile f A (x) from a radial density 
function /(r), we have one example of a way in which the one-dimensional Abel 
transform arises. If the density distribution is f(x,y), which is not symmetrical but 
depends on two coordinates, the scans may still be taken but they will depend 
on the direction of scanning 6. Calling the abscissa for each scan R, we define the 
Radon transform g„(R) of the function f(x,y) by 

f 00 f 00 

g e (R) = f(x,y)8(R — x cos 6 - sin 6)dxdy. 

How to invert this transformation, that is, given the scans g e (R), usually for con¬ 
tinuous R and a discrete set of scanning directions 6, to arrive at the unknown 
function f(x,y), became very important with the advent of computer-assisted to¬ 
mography. Chest x-rays of the lungs are degraded by unwanted images of ribs 
superposed both in front of and behind the features of interest. The possibility of 
obtaining the density distribution within a slice of tissue inside the body by 
x-rays without shadowing by ribs or other contiguous tissue has revolutionized 
diagnosis, first by computer-assisted tomography (CAT scans) and then by NMR 
(nuclear magnetic resonance) imaging. Tomography, before computing, was a 
technique of defocusing the foreground and background by translating the x-ray 
source during the exposure and simultaneously moving the x-ray plate in the op¬ 
posite direction at the appropriate speed. 
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Fig. 13.8 


A density distribution in the 
(*,y)-plane is scanned by a 
line L moving in the 
R-direction to generate a 
projection. 


The factor S(R — x cos 6 — y sin 0) is zero everywhere except where its ar¬ 
gument is zero, which is along the straight line x cos 9 + y sin 6 - R (Fig. 13.8). 
This straight line L represents the slit when it is at a perpendicular distance R 
from the origin and inclined at an angle 0 to the y-axis. If 0 is kept fixed, say at a 
value 0j, while R is varied, then the integral g e ,(R) constitutes the projection of the 
density distribution f{x,y) onto the line 6 = 0 X as a function of R. The resulting 
profile is referred to as a single scan. 

The practical computational method for inversion was arrived at by Fourier 
transforming the Radon integral equation, finding a method of solution, and then 
retransforming the steps to end up with data-plane operations in which numeri¬ 
cal Fourier transformation is actually dispensed with. The technique, known as 
modified back-projection (Bracewell and Riddle, 1967), was developed in con¬ 
nection with radioastronomical imaging where a distributed source of radiation 
is scanned by an antenna that receives from a narrow strip of sky whose orien¬ 
tation 6 can be varied between scans. 

The inversion procedure derives from a remarkable connection that exists be¬ 
tween the Fourier, Abel, and Hankel transforms and from a generalization known 
as the Projection-Slice Theorem. 

The Abel-Fourier-Hankel ring of transforms. Starting with an even function 
f(r), if we take the Abel transform, then take the Fourier transform, and finally 
take the Hankel transform, we return to the original function f(r) as shown in 
Bracewell (1956). For example, starting with f(r) — S(r - a), which is a ring im¬ 
pulse located on the circle r = a, we take the Abel transform (Table 13.9) to get 
2 a/va 1 — ^U{x/2a), the Fourier transform of which is 2TTa} 0 {2iras) (Pictorial Dic¬ 
tionary). From Table 13.2 we verify that the Hankel transform of the Bessel func¬ 
tion is 8(r — a), the function we started with. 

Projection-slice theorem. When a two-dimensional density distribution is a 
function of radius alone, all three of the above transformations are one-dimen¬ 
sional but f(r) can be generalized to become a function f{x,y) of both x and y and 
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what was the Hankel transform above generalizes to a function F(u,v) of u and 
v. These two two-dimensional functions constitute a two-dimensional Fourier 
transform pair, as explained earlier in the chapter in connection with the Hankel 
transformation. One way of thinking about Fourier transformation in two di¬ 
mensions is to note that F(u, 0), the slice through F(u,v) along the M-axis, is given 
by putting v - 0 in the two-dimensional Fourier transform definition to get 

F(w,0) = J f{x,y)dy e ' 2nux dx. 

The item in square brackets is the projection of f(x,y) on the x-axis. The remain¬ 
ing integral with respect to x simply transforms the projection. In consequence, 
when /(x, y) is given, one slice through F(u,v), namely the one along the u-axis, 
is obtainable by first projecting /(x,y) onto its x-axis and then taking a one¬ 
dimensional Fourier transform. The Projection-Slice Theorem says that the slice 
through F(u,v) at any angle 6 X in the («,<y)-plane, i.e., along a line parallel to the 
axis R in the (x,y)-plane, is obtainable as the Fourier transform of the projection 
of /(x,y) onto the axis R in the (x,y)-plane (Bracewell, 1956). 

Reconstruction by modified back projection. Now the process of tomogra¬ 
phy is to project a certain /(x,y) at various angles 6, preferably numerous and eq- 
uispaced; consequently those parts of the transform F(u,v) can be deduced that 
lie on slices at corresponding angles. From knowledge of F(u,v ) one can recover 
/(x,y) by two-dimensional Fourier transformation; but to do this one must first 
interpolate onto a square grid in the (u,u)-plane in order to be able to utilize avail¬ 
able algorithms. Such numerical interpolation proves to take more time than the 
transformation. To avoid interpolation we note that in the (u,u)-plane, the data 
points resulting from the various one-dimensional transformations lie on diverg¬ 
ing spokes 6 = const. The density of points is thus inversely proportional to ra¬ 
dius, a nonuniformity that can be corrected for by multiplication by the absolute 
value of radius in the (u,u) plane. Let M be a spatial frequency in the (w,i;)-plane 

beyond which no content is expected, and let q = \/m 2 + u 2 . Then the correction 
factor is Y\{q/2M) — A {q/M). After such correction a two-dimensional Fourier 
transform would deliver the desired /(x,y). 

But the multiplicative correction to values along the slice in the (w,u)-plane 
corresponds to a rather simple convolution operation on the original projections 
g e (R) in the data domain, an operation that produces a modified scan 

g e (R) = ge{R) * (2M sine 2M R — M sine 2 M R). 

Thus the inversion procedure for the Radon transform is (a) to modify each mea¬ 
sured scan by simple convolution to get g e (R), ( b ) to back-project, and (c) to ac¬ 
cumulate the separate back projections over the (x,y)-plane. Back projection is to 
distribute the modified scan g B ,(R) uniformly over the (x,y)-plane in the direction 
perpendicular to the R-axis. For more details see Bracewell (1995) and Deans 
(1983). 
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THE HILBERT TRANSFORM 


The Hilbert transform has a variety of applications; the ones to be mentioned here 
concern causality and the generalization of the phasor idea beyond pure alter¬ 
nating current. 

We define the Hilbert transform of f(x) by 


w - ~f. 


/(*') Ax’ 
x' - X 


The divergence at x = x' is allowed for by taking the Cauchy principal value 
of the integral. It will be seen that F Hi (x) is a linear functional of /(*); in fact it is 
obtainable from f(x) by convolution with (— itx)~\ To emphasize this relation¬ 
ship, we may write 



/(*)• 


From the convolution theorem we can now say how the spectrum of F Hi (x) is re¬ 
lated to that of f(x). 

The Fourier transform of (—7rx) 1 is i sgn s (Fig. 13.9), which is equal to +i 
for positive s and — i for negative s; hence Hilbert transformation is equivalent to 
a curious kind of filtering, in which the amplitudes of the spectral components 
are left unchanged, but their phases are altered by 7t/2, positively or negatively 
according to the sign of s (Fig. 13.9). 

Since the application of two Hilbert transformations in succession reverses 
the phases of all components, it follows that the result will be the negative of the 
original function. Hence 

m = “(^) * F » 



Fig. 13.9 The kernel (— me) 1 and its Fourier transform i sgn s. 
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Fig. 13.10 The left-hand column shows a function and the result of two successive 
Hilbert transformations, while the right-hand column shows the corre¬ 
sponding Fourier transforms. 


or 



Fn(x')dx’ 
x’ - X 


Had the kernel been chosen as [i7r(x' — x)] -1 instead of [7r(x' — x)] _1 , the 
transformation would have been strictly reciprocal, for then the effect would have 
been to multiply the spectrum by sgn s, and two such multiplications produce no 
net change. The custom is to sacrifice the symmetry which would be gained by 
this procedure in favor of the property that the Hilbert transform of a real func¬ 
tion should also be a real function. 

It will be noticed that all cosine components transform into negative sine com¬ 
ponents and that all sine components transform into cosines (Fig. 13.11). A con¬ 
sequence of this is that the Hilbert transforms of even functions are odd and those 
of odd functions even. 
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Fig. 13.11 Explaining the Hilbert transform of cosine and sine functions (left) in 
terms of their spectra (right). 


The analytic signal. Consider a real function /(f). With it we may associate 
a complex function 

m - ;FHi(f), 

whose real part is /(f). In signal analysis and optics, where the independent vari¬ 
able is time, this associated complex function is known as the analytic signal, and 
the Hilbert transform is referred to as the quadrature function of /(f). As an ex¬ 
ample, the quadrature function of cos f is — sin f and the analytic signal corre¬ 
sponding to cos f is exp it. One might say that the analytic signal bears the same 
relationship to /(f) as exp it does to cos f. 

Just as phasors simplify manipulations in a-c theory, so the analytic signal is 
useful in some situations in which departure from absolutely monochromatic be¬ 
havior prevents use of phasors. Modulated carriers and laser signals furnish ex¬ 
amples. Figure 13.12 shows a function /(f) that could be regarded as a modulated 
carrier; that is, it is a quasi-monochromatic pulse that slowly builds up and dies 
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Fig. 13.12 An amplitude modulated carrier /(f), its quadrature function F m (t), and 
the associated complex analytic signal. 

away. Its Hilbert transform is also shown, and together the two constitute the 
complex function of time represented by a helix that slowly dilates and contracts. 
The original signal /(f) is the projection of this twisted curve on the plane defined 
by the time axis and the axis of reals (the vertical plane shown), and the quadra¬ 
ture function f Hi (f) is the projection on the horizontal plane. 

If a mean angular frequency <w can be assigned, the analytic signal can be 
written 

vity* 1 , 

where the complex coefficient V(t), since it is a generalization of the phasor, can 
be described as a "time-varying phasor." In the case illustrated in Fig. 13.12, V(f) 
is real and slowly rises and falls in value. If there were some frequency modula¬ 
tion, V(t) would also rock backward and forward in phase. 

From the explanation it is clear that the analytic signal contains no negative- 
frequency components; in fact it is obtainable from f(t) by suppressing the neg¬ 
ative frequencies. For example, noting that 

cos cot = ---, 

we obtain the analytic signal by suppressing the negative-frequency term exp 
(- iait). It is also necessary to double the result. To show this directly, let /(f) D F(J) 
and let/(f) be derived by suppressing the negative frequencies and doubling: 

/(O =5 2 H(J)F(J). 
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it follows that 


/(<) = 2 


i m + 


2nt 


m 




= m - 


Thus /(f) is indeed the analytic signal, as originally defined. 


Instantaneous frequency and envelope. There is some question how one 
might define the envelope of a signal, since it only touches the signal waveform 
from time to time and might do anything in between. Similarly, the frequency of 
a quasi-monochromatic signal is not obviously defined from moment to moment. 
However, one does not hesitate to say what the amplitude of a sine wave is be¬ 
tween peaks; furthermore, there is equal confidence about the moment-to- 
moment frequency as long as the maxima and minima, and the zero-crossing in¬ 
tervals remain steady. Since the analytic signal V(f) exp i(ot is defined for contin¬ 
uous f we may say that, in the not strictly sinusoidal, or monochromatic, case 
|V(f)| is the instantaneous amplitude, or envelope, and that the time rate of change 
of the phase of the analytic signal is the instantaneous frequency. 

To compute instantaneous amplitude from a given /(f) requires adoption of a 
mean angular frequency w, a parameter that may be assigned with confidence to 
some waveforms. For example, with an AM radio signal you would take w to be 
the carrier frequency. But in general, w and V(f) are not uniquely defined; conse¬ 
quently, when you see the term envelope used for V(f) be prepared for surprises. 


Causality. It is well known that effects never precede their causes, and so /(f), 
the response of a physical system to an impulse applied at f = 0, must be zero 
for negative values of f: 

/(f) = 0 f < 0. 

Impulse responses satisfying this condition are said to be "causal." This condi¬ 
tion is sometimes called the condition of "physical realizability," which is a bad 
term because it ignores the fact that a system may be impossible to construct for 
quite other reasons. 3 

Consider some real function /(t). The most general causal impulse response 
has the form 

/(f) = H(f)/(f). 

The spectrum of /(f), namely the transfer function T(f), where 

T(f) = [°° /(fV *<' dt, 

J -oo 


3 In the literature the term "physical realizability" may include a second condition having nothing to 
do with causality, namely, that l(t) should die away with time in such a way as to eliminate circuits, 
such as transmission-line segments, that do not have a finite number of degrees of freedom. 
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must have a special property corresponding to the causal character of /(f), and 
from the previous discussion of the analytic signal this property must be that the 
real and imaginary parts of T(f) are a Hilbert transform pair. Split /(f) into its 
even and odd parts: 

/(f) = E(f) + O(f) 

= im + K-t)] + i[/(o - z(-o]. 

Now since O(f) = sgn fE(f), and sgn f D —i/vf, 

/(f) = (1 + sgn t)E(f) 

3 G(/) + '(f}) * 

Hence all causal transfer functions T{f) are of the form 

T(J) = G(f) + 

where B(f) is the Hilbert transform of G(/); that is. 


and 


Bin 

r-f 

Several Hilbert transforms are listed in Table 13.11 


Gif') 

r-f 

1 f°° B(f') 


1 foo G(f') 


COMPUTING THE HILBERT TRANSFORM 

It would appear that the Hilbert transform of f{x) could be computed as follows. 
First discretize at unit interval in x. Take the discrete Fourier transform, multiply 
by i sgn s (which is the Fourier transform of —i/vx), and invert the transform. It 
is simpler, however, to discretize f(x) and convolve with a set of coefficients rep¬ 
resenting — 1/7 tx. For example, if a semispan of N = 5 sample spacings was 
deemed sufficient the 2N + 1 coefficients would be 

(.064 .080 .106 .159 .318 0 -.318 -.159 -.106 -.080 -.064). 

It might seem more satisfactory to restrict the dependence of each Hilbert trans¬ 
form value to the immediate vicinity than to involve the behavior of /( x) far away. 
The reason for concern about distant places has to do with the coefficients that 
are discarded when a span of only 10 is adopted (or any other finite span), be¬ 
cause the sum of the discarded coefficients is infinite (on the left) or minus infin¬ 
ity (on the right). By convolving with the finite set of coefficients we trust that the 
two infinities will cancel, but how can they after data samples have been multi¬ 
plied in? A second concern is the discrete sampling interval, which must be kept 
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■ TABLE 13.11 

Some Hilbert transforms 


fix) 

Fmix) 

const. 

0 

cos X 

— sin x 

sin x 

COS X 

cos 2 X 

—| sin 2x 

sin 2 * 

\ sin 2x 

cas x 

cas(-x) 

e x 

ie" 

x _1 sin x 

x“'(cos x — 1) 

n(x) 

it-' In |(x - \)/{x + |)| 

A(x) 

l(* - 1 V(* + 1)1 + In W ~ 1)1} 

A(x) sgn x 

-«- _, {(l ~ *) ln l*/(* + 1)1 + 1} 

1/(1 + X 2 ) 

-*/(l + x 2 ) 

sine' x 

- it sine x - \ir sine 2 }x 

5(x) 

— 1/7TX 

«'(*) 

1/77-X 2 

«"(*) 

—2/jtx 3 

M _V2 

|x|- J 

|x|~* sgn x > 

-|x| _i sgnx 

(1 - x 1 )n(x/2) 

-ir-'Kl-x^ln |(x - l)/(x + 1)| - 2x} 

(1 - x 2 )*n(x/2) 

-x + (x 2 - lftl - n(x/2)] sgn x 

(1 + x)/(l + X 2 ) 

(1 - x)/(l + x 2 ) 

n(x) 

x/ril - x 2 ) 

*i(*) 

-i Mi - **) 

III(x) 

~’Z™.- co COt[lT(x ~ «)] 


small enough to work against aliasing of signal content where |s| > 0.5. This con¬ 
cern might seem to be alleviated by the Fourier transform approach, but in fact 
it is not. 

First note that the convolving function h(x), represented as a string of 
impulses 


N 


M*) = 2 
« = 1 


~ s ( x + n ) - - n ) 
tv n ttti 
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has a Fourier transform 



that can be compared with the desired transfer function i sgn s (Fig. 13.13). The 
phase is correct, 7 t/ 2 for positive s and -tt/2 for negative s, but the amplitude in¬ 
stead of having magnitude unity as desired (see the fine line), discriminates against 
both high and low frequencies, treating only a relatively narrow band peaking 
near 0.45N with approximately unity transfer function. Samples of 1/ttx taken at 
x = ± \, l\, ... instead of at eleven integer values of x lead to the same outcome. 

Now the transfer function achieved by the Fourier method fails similarly, hug¬ 
ging the line from (0,1) to (0.5, 0) more or less tightly according to the length of 
the data set, despite the fact that the multiplying factor i sgn s has unit amplitude 
for all s. The saw-tooth behavior can be traced to unavoidable aliasing due to un¬ 
der sampling. 

One can obtain a satisfactory envelope for a narrow-band oscillatory function 
such as the sunspot number series (Bracewell, 1985) but in general it is recom¬ 
mended that the N = 5 convolution method be tried on a few sinusoidal signals 
in the frequency band occupied by the data. Drooping of the transfer function be¬ 
low unity can then be corrected empirically. Pulsations that appear on the enve¬ 
lope between the expected points of tangency to the data can be reduced by ad¬ 
justing the discretizing interval. Further improvement can be sought by changing 
to the Fourier method and adjusting the Fourier transform by division by |H(s)| 
over the band of interest. 

Hilbert transformation can be performed numerically on any finite-duration 
signal but has some unpleasant attributes that are not obvious when the Hilbert 
transform is invoked in an analytic context. 

Hilbert transformation may be implemented using the discrete Hartley trans¬ 
form as follows. Let the data /(t) be specified for values of r running from 0 to 
N — 1. Take the Hartley transform H(v) and swap N /2 — 1 pairs of values to form 



Fig. 13.13 The transfer function with amplitude sgn s required for Hilbert trans¬ 
formation (fine line) compared with the transfer function actually 
achieved (curve) with the 11-element convolving sequence. The Fourier 
method applied using the same discretizing interval fails in a similar 
way, hugging the broken line. 
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H 2 (v). In each swap, one of the elements changes sign as indicated. Thus 
replace H = |H(0) H( 1) H(2) H(3) H(4) H(5) H(6) H(7)} 



byH 2 ={H(0) — H(7) -H(6) ~H(5) H(4) H(3) H(2) H( 1)} 

Take the inverse Hartley transform of /(f) to get the Hilbert transform (Pei and 
Jaw, 1989). 


THE FRACTIONAL FOURIER TRANSFORM 


As noted in Chapter 2, the repeated Fourier transformation < 3 f( 3 r f(x) yields /(—x) 
while four applications & f 3 r & f 9 > f(x) comes full circle and yields the original f(x). 
In two dimensions, <F&f{x,y) yields f(-x,-y), which can be regarded as a rota¬ 
tion of f(x,y) through an angle 7r, while S'SFS'SF/(x,y), or £F 4 for short, introduces 
a further rotation tt that returns to the original f(x,y). 

Letting the notation represent a applications of the Fourier transform we 
now have interpretations S'" for a — 1, 2, and 4, and can readily generalize to any 
integer value of a such as 0 and 3; the case S' -1 would be the inverse Fourier trans¬ 
formation, whose kernel is exp ilnsx. The Fourier transform of order a, where a 
is an integer, exhibits 


consistency 

additivity 

commutativity 


&“ = &<' when a = 1, 


_ pu+b 

= F b F, 


and linearity 8F fl (/ + g) = + 3* a g. 


Is there an algebraic generalization that retains these group-theoretical prop¬ 
erties when a is not restricted to being an integer? For example, can meaning be 
given to a half-order Fourier transform S' 5 ? It would be required to possess the 
above properties; in particular, half-order transformation applied twice in suc¬ 
cession should exhibit additivity and thus yield the ordinary Fourier transform. 
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Fig. 13.14 Three focusing arrangements that produce Fourier transforms in the 
planes marked by •. (a) A lens of focal length/. (b) A spaced set of 
thin lenses, (c) An optical fiber with radially graded refractive index. 


When the FFT is computed as described in Chapter 11, the data set of N val¬ 
ues is replaced in successive stages until a final set is reached that is the desired 
transform. The intermediate stages can be viewed as partial transformations, and 
the middle one might be a half-order candidate. To follow up this idea one would 
have to deal with the fact that there is a middle stage only for N = 8, 32, ... and 
with similar restrictions for values of a other than one-half. Permutation would 
have to be distributed over the stages too, instead of being concentrated at the 
beginning or end, and the resulting flow diagrams for each stage would have to 
be the same. 

This discussion nevertheless offers a concept for developing a fast algorithm 
for computing purposes. A physical approach is offered by a two-dimensional ex¬ 
ample from diffraction theory, where a field distribution f{x,y) in one plane can 
excite in a parallel plane, by Fraunhofer diffraction, a field distribution that is the 
two-dimensional transform of f(x,y). Therefore the field distribution in an inter¬ 
mediate plane is a candidate for a fractional transform with 0 < a < 1. Radiation 
diffracted by an aperture in the first plane spreads out in space, ultimately ap¬ 
proaching the Fourier transform on the plane at infinity, a configuration that can 
be compacted by insertion of a simple lens of focal length/behind the (x,y)-plane, 
whereupon the transform will appear nearby in the focal plane of the lens at z = /. 
A difficulty arises that is reminiscent of permutation which, in the computing case, 
is normally concentrated at a single stage. In the lens case, it is the focusing that 
is concentrated at one place. 

However, focusing in practice can be distributed (Fig. 13.14); one way is to 
replace the lens by several thin lenses distributed between the function plane and 
the transform plane. In addition continuous focusing is already available in cer¬ 
tain types of existing optical fiber, any slice of which is a disc that acts just like a 
thin lens. A lens achieves focusing by being thicker on axis and thus delaying the 
axial ray relative to the outer rays as required for all to arrive at the focus in the 
same phase; a disc sliced from a fiber or rod can delay the axial ray by having a 
greater refractive index on axis. 

Let the refractive index n fall off quadratically from a central value n 0 on the 
axis (just as lens thickness varies quadratically) according to the formula 
n = n 0 (l — i^fh 2 ). Such a dielectric is known as a graded refractive index medium. 
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A field distribution f(x,y, 0) on the entry plane 2 = 0 gives rise to the Fourier trans¬ 
form (corresponding to a — 1) in the plane z — L, where L = nh/2\ // 2n (} . The half¬ 
order transform (a = 5 ) appears half way and other fractional orders appear 
at distances aL from the aperture. The detailed theory of wave propagation in 
a graded medium is the background for the definition adopted below for the 
fractional-order Fourier transform. 

Reverting to a one-dimensional independent variable, as exemplified by time 
f, let f(t) have a Fourier transform F{f), and define its fractional Fourier trans¬ 
form of order a, where a is a fraction between 0 and 1 , by 


(AW-fr) r oo 

V a m = W) = 77 = /(f)exp 
V sin <t> 1 00 


— i2ir 


ft — |(f 2 + 47 r 2 / 2 ) cos <f> 
sin <£ 


dt, 


where <f> = \na. This definition is derived from Namias (1980) by elimination 
of a factor \/27r to conform with system 1 of Chapter 2. Testing for consistency 
by putting a = 1 we find t\{f) = f(t)exp(-i27rft)dt, which is the same as F(). 

For o —> 0 a painstaking limiting process (McBride and Kerr, 1987) confirms that 
the defining expression approaches /(), the original function. Use of frequency /, 
whose unit is one cycle per unit of t, as the independent variable for the transform 
lends some familiarity to the expressions. An unfamiliar feature is that the frac¬ 
tional transform glides continuously from the time domain to the frequency do¬ 
main; this peculiarity is glossed over if the independent variable is taken to be di¬ 
mensionless. Some theorems and examples of fractional transforms are as follows. 


Shift theorem. If /(f) has fractional Fourier transform F a (f) then 
& a f(t -T) = e ~ ,Tsin c°s <f>)p a (j - T cos <f>). 


Derivative theorems. 


*"/'(«) = {ilirf + cos * 

9T(‘) = (a*f + cos <*> j- 

9‘tf{t ) = - firf cos </, + i sin * 

- ( 2 ™f cos 0 + i sin 0 F JJ)< 

Fractional convolution theorem. 

fit) *° 2(0 = e-* [°° fiT^git - T^'-^dr, 

J — oo 

where b = \ cot fena). 

Examples of transforms. 


SF fl fi(t) = - __ eHAfcot*. 

V sin <f> 
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_ , N . 2tt/T - 7r(47r 2 / 2 + T 2 )cos <?> 

3*8(t - T) = ■■ ■ e -L _ _ 

v sin (f> sin * 

^- 1 *) /27TfT\ 

&°[8(t + T) + S(f - T)1 = . gWVf+iV* <#> 2 cos ( -r^— . 

Vsin«/> \sm <£/ 

?rH„(\/2^t)e-* t2 = e ina H„(V2ns)e-^, 

where the H„(x) are Hermite polynomials (see Problem 8.25 for listing), and the 
orthogonal functions H„(V 2nx)e~ nt2 are eigenfunctions of the fractional Fourier 
transform. 


Applications. Applications to solving Schrodinger's and other second order 
differential equations in one or more dimensions are illustrated by Namias (1980). 
Applications in optics, especially to optical fibers (Mendelovic and Ozaktas, 1993; 
Ozaktas and Mendelovic, 1993a) and to optical information processing systems 
(Ozaktas and Mendelovic, 1993b) have been reported and followed up. Lohmann 
(1995) has related the fractional Fourier transform to rotation of the Wigner dis¬ 
tribution with implications for time-frequency analysis of signals (Mendlovic et 
al., 1996). Sheppard (1998) has derived a relationship between free-space diffrac¬ 
tion and the fractional Fourier transform, while Kutay and Ozaktas (1998) have 
demonstrated restoration of optical images. 

Noting varying disadvantages of working with complex integrals Mendlovic 
et al. (1995) have demonstrated a fractional optical transform that is real, starting 
from a technique of Bracewell et al. (1985), for the two-dimensional optical Hartley 
transform. If V(t) has one-dimensional Hartley transform H(f) = Jf^cas 2tt ft dt 
then for the fractional Hartley transform of order a one has 


H JJ) = -7= f“ /(!)<=* 

v sm 4> - 1 00 


ibr ~ 5 </>) + 2 tt 


ft — \(t 2 + 47T 2 / 2 )cOS <f> 
sin 4> 


dt. 


Future applications may be expected in the area of lens system design. Other 
branches of physics where situations analogous to optical guiding occur include 
ion beams, where magnetic focusing is utilized (Pierce, 1954), and magnetospheric 
physics, where 5 to 15 kHz radio waves from lightning escape into ducts that 
guide the radiation to the opposite hemisphere (Helliwell, 1965). It is striking that 
the quantum mechanical harmonic oscillator wave functions are the same as the 
natural modes of a graded-index optical fiber and of a laser cavity and at the same 
time are the eigenfunctions of the fractional Fourier transform operator. The frac¬ 
tional Fourier transform offers a new window on old topics. 

For an unrelated confusingly-named discrete transform based on fractional 
roots of unity rather than the conventional Nth roots of unity exp(— Htt/N), see 
Bailey and Swartztrauber (1990). 
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PROBLEMS 

1 . Demonstrate the following theorems relating to a function f(x) and its Hilbert 


transform F H i(x). 




(*> 


f(ax) D F H i(«*) 

(similarity) 

{b) 


fix) + 3 Fh,(*) + G H i0) 

(addition) 

(c) 


fix ~ a) D F K ix - a) 

(shift) 

id) 


f °° /(*)/*(*) dx = 

J -OO 

f oo 

FHi(x)Ftii(x) dx 

' -oo 

(power) 

(e) 

r 

J -00 

f*{x)f(x - u)dx = 

f"° FffctoFHiC* - U) dx 

' -oo 

(autocorrelation) 

if) 


f*gD- 

Fm * Ghj 

(convolution) 


2. Hilbert transform of convolution. Let 9€/ represent the Hilbert transform of f{x). 
Show that the Hilbert transform of a convolution can be expressed as follows: 

3. Autocorrelation. Explain why a function and its Hilbert transform have the same au¬ 
tocorrelation function. 

4. Uniqueness. It is said that the Hilbert transformation is not unique because the trans¬ 
form of unity is zero. Consequently, the inverse transform of zero would be any con¬ 
stant, and therefore the Hilbert transform of any function would be uncertain to the 
extent of an additive constant. Examine this argument critically and make an authori¬ 
tative report on the question of uniqueness. 

5. What are the analytic signals corresponding to the following waveforms: sine t, 
exp [—(t - t 0 ) 2 ] cos cot, (1 + M cos Ctt) cos o>f? Make three-dimensional sketches 
showing the analytic signal and its two projections. 

6. Creating Hilbert pairs. Generate Hilbert transform pairs by separating the real and 
imaginary parts of the Fourier transforms of the following physically realizable im¬ 
pulse-response functions: exp (— t)H(t), t exp (-f)H(f), A(f - 1), exp (— t) cos (ot H(t). 
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7. Generate Hilbert transform pairs by taking the Fourier transform of the odd and even 
parts of the following physically realizable impulse-response functions: 

mm. n(f - 1). 

8. A real function of f is zero for t < 1. Prove that the real and imaginary parts of its 
Fourier transform form a Hilbert transform pair. 

9. Precocious causality. What can be said about the Fourier transform of a real function 
of f that is zero for t < —1? 


10. Let the transfer function T(f) of a filter be expressed as 

T(J) = «W) f 

where 0(/) is the complex electrical length. Show that 0(/) is hermitian. 

11. In the preceding problem, let 

©to = «a) + mi 

where a(f) is the gain and j3(/) the phase change of the filter. Thus if 

tv) = cv) + mi 

then a(f) — log (G 2 + B 2 )\ = log |T| 

g 

and (3(f) = tan -1 — = pha T. 

G 

It has been shown that 0(/) is hermitian, that is, that 0(—/) = 0*(/), or that a(f) is 
even and (3(f) is odd. To prove this, was it only necessary to assume that T(f) was her¬ 
mitian [/(f) real]? If so, what further property must a(f) and (3(f) exhibit if T(f) is, in 
addition, causal? 


12. Causal filter. If G(f) + iB(f) is the transfer function of a causal filter, show that 




2/ foo G(k) 


and 


'o f - » 

2 , *._£<*)_ 
u ' rr Jo f 2 - u 2 


du 


13. What can be said about the Hilbert transform of a function that is hermitian? 


14. Band-limited functions. Show that the Hilbert transform of a band-limited function is 
band-limited. 

15. A function /(f) is band-limited. It is said that from a knowledge of f(t)H(— f) only, the 
whole of /(f) can be deduced. Examine this statement. 

16. Show that the Hankel transformation is equivalent to an Abel transformation followed 
by a one-dimensional Fourier transformation, or that 

2t r| o °“ dr / 0 (2?r£r)r J ^ ds e*™ dx 2xf(x)(x 2 - s 2 ) -i = /(f). 
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17. 2 transform. Let the impulse train 

oo 

^/(n)«(f - n) 
o 

possess a Laplace transform where a < Re p < Show that the z transform F(z) of the 
sequence f[n) exists in an annulus of the z plane where e~ p < |z| < e a . 


18. Establish the following Hankel transform pairs. 


/ 0 (2 t rar) 

Jl(2irar) 

/'inc r = (2r)- , /,(7rr) 
j inc 2 r 
r ”Jn{r) 
exp (ir 2 ) 
sine 2 ar 


(27Tfl) 1 8(q — a ) 

TT~ 2 q~ l (ir~~ 2 — q*)~ln(irq/2) 

n (q) 

|[cos' 1 <7 - q(\ - <?}\n(q/2) 

2tt( 1 - 47r 2 ( ? 2 )"- 1 n(7rg)/2' , - 1 (n - 1)! 

in exp (-in 2 q 2 ) 

( 7 rfl 2 ) -1 cosh -1 (a/q) 


19. Shear theorem. If /(x,y) has F.T. F{u,v), show that /(r,y — ax) has F.T. F(u + av, v). 

20. Instantaneous musical pitch. A sound wave producing an air-pressure variation at the 
ear of 0.01 cos [27r(500f 4- 50t 2 )J newtons/meter 2 could be described as a moderately 
loud pure tone (54 decibels above reference level of 0.1 newton/meter 2 ) with a rising 
pitch. At f = 0 the frequency would be 500 hertz and rising at a rate of 100 hertz per 
second and after 2 or 3 minutes the sound would fade out as it rose through the limit 
of audibility. 

(a) How long would it take for the pitch to rise 1 octave (1) starting from 500 hertz; 
and (2) starting from 6000 hertz? 

(b) Calculate the rate of change of frequency in semitones per second. 

(c) Construct a waveform that would be perceived by the ear as a pure tone having a 
uniformly rising pitch. Arrange that the tone rises through 500 hertz at a rate of 100 
hertz per second. 

21. Two-dimensional diffraction. A plowed field of 300 hectares is three times longer than 
it is wide and the furrows are three to the meter. The long axis of the field is oriented 
20° east of north. On a (u,v) plane, with the u axis running east, sketch and dimension 
the principal features of the two-dimensional Fourier transform of h(x,y), the height of 
the surface of the field. Conceive of a situation where the Fourier transform of a plowed 
field might arise. 

22. Two-dimensional transform. An antenna in the form of a diamond-shaped or rhombic 
aperture has a long diagonal N wavelengths long and a short diagonal of n wave¬ 
lengths. If N and n were equal, the aperture would be square and we know that the an¬ 
gular spectrum would be sine U sine v, and there would be null lines in directions 
u = ±\,v = ±1, etc. The following argument was presented. "The null lines are con¬ 
nected with the four directions of symmetry of a square aperture, two parallel to the 
sides and two parallel to the diagonals. But the rhombic aperture is symmetrical about 
its diagonals only. This leaves a lattice of discrete directions on which the angular spec- 
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trum is zero, but the null lines are destroyed no matter how little the comer angles de¬ 
part from 90 degrees." Is that right? 

23. X-ray diffraction. The atoms in a certain plane of a crystal lie on a square lattice of spac¬ 
ing 0.54 nanometer and give rise to a square pattern of diffraction spots when illumi¬ 
nated by an x-ray beam, as would be expected since the two-dimensional Fourier trans¬ 
form of 2 IU(;r,y) is 2 lll(u,v). The crystal is now traversed by a microwave acoustic wave 
that places the plane mentioned in periodic shear. Opinions given by colleagues in¬ 
clude the following. 

(a) The diffraction spots will be displaced and the direction of displacement will de¬ 
pend on the wave direction in the plane. 

(b) The spots will be widened in one direction only. 

(c) The spots will be enlarged. 

(i d ) The spot structure may be destroyed because the crystal strain could be large 
enough to prevent the constructive interference of the extremely short x-ray wave¬ 
lengths on which the spots depend. 

(e) Any effect would be so small compared with the spot size as to be undetectable. 
Comment on these opinions. 


24. Three-dimensional diffraction. X-rays incident on a crystal are scattered by the orbital 
electrons. Therefore, it is in principle possible by observing the scattered intensity in all 
directions to deduce the electron density in the crystal and then possibly to reason out 
the locations of the various atomic nuclei, even though the nuclei themselves are not 
probed. Let the electron density in a spherically symmetrical case be p(r). Show that the 
intensity of scattering K(s) is a function of one variable only and that p(r) may be cal¬ 
culated from 

f oo 

p(r) = 47 t I K(s) sine 2rs ds. 

What is the physical meaning of s and how could a crystalline substance in any way be 
regarded as spherically symmetrical? 


25. Three-dimensional convolution. Consider a ball function n(£), that is, a function of x, 
y, and z that is equal to unity inside a sphere of unit radius and zero outside. Show that 
its three-dimensional autocorrelation function (or self-convolution) is 


"©*** n (CKfX- 


3r r 2 
2 + 8 



26. Two-dimensional impulse. State the nature of the following impulse symbols in two 
dimensions by giving (a) the locus where the impulse is located and (b) the linear den¬ 
sity at each point of the locus: 8(x + y), S(xy), 8( sin 6), tyx 2 + y 2 - 1), 8(x 2 + y 2 ). 

27. Derivative theorems for Hankel transform. Show that 

(r/y D -(qpy 

and that /' D -[^{r -1 /}]'. 

28. Derivative theorem for Hankel transform. Show that 

r/'(r) D -q 1 ~[q 2 F(q)]. 
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29. Hankel transform theorem. Show that 

/w- 4"£4 

30. Henkel transform example. Establish that the Hankel transform of r 2 exp(-7rr 2 ) is 
(tt -1 - q 2 ) exp (—nq 2 ). 

31. Hankel transform. Show that 

| 0 Ji(x)J 0 {ax) dx = H(1 - a 2 ). 

32. Hankel transform example. Verify that (47TT 2 )' 1 J 2 (7rr) has Hankel transform 

(i - <7 2 )n (q). 

33. Cauchy principal value. We often use the phrase "area under the curve f(x)" to mean 
the integral from — oo to oo. Intuitively, from experience with areas, one might expect 
that the area under f(x) is the same as the area under f{x + 1). Can you prove that 

f ee foe 

sgn x dx = sgn (x + 1) dx? 

—oo J -00 

34. Radial sampling under circular symmetry. The light from a star is received at two 
points spaced a certain distance q apart and the complex correlation between the two 
optical waveforms is determined. It can be shown that this complex number is a value 
of the Hankel transform B(q) of the brightness distribution b(r) over the stellar disk (as¬ 
suming that the brightness distribution has circular symmetry). (If r is measured in ra¬ 
dians, q will be measured in wavelengths.) Since the star is of finite extent, it suffices to 
sample the transform at regularly spaced distances. Show how to determine b(r) from 
values of B(q) determined at q = 0, a, 2a, • •. . 

35. Abel transform. Let /(■) be subjected to two Abel transformations in succession. Show 
that the resulting function f AA {x) is equal to the volume under /(■) outside radius x, 
that is, f AA (x) = 277/“ r/(r) dr. (This problem was supplied by S. J. Wemecke.) 

36. Two-dimensional autocorrelation. Let /(r) have Abel transform f A {x). If we take the 
two-dimensional autocorrelation of /(r), we get another circularly symmetrical func¬ 
tion. Show that the Abel transform of the two-dimensional autocorrelation is the one¬ 
dimensional autocorrelation of the Abel transform f A (x); that is, f(r) ** f(r) has Abel 
transform F/(x) * f A (x). 

37. Abel-Fourier-Hankel cycle of transforms. Functions can be spatially arranged in 
groups of four to exhibit the Abel-Fourier-Hankel cycle of transforms (R. N. Bracewell, 
Austral. J. Phys., vol. 9, p. 198,1956, and Problem 13.16). Thus the relationships 

jinc r has Abel transform sine x 
sine x has Fourier transform fl(g) 
n( ? ) has Hankel transform jinc r 
n(q) has Abel transform (1 — 4w 2 ^Il(w) 

(1 - 2u 2 )in(u) has Fourier transform jinc r. 
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where jinc r = (2r) 1 /i( 7rr )/ are a ll compactly summarized by grouping the four func¬ 
tions as in the box. 


jincr (1 — 4M 2 )’n(«) 


sine x U(q) 


Fo^e,-HJ, 

4bel Hankel Abe 

L_ XI 

-Fourier-$9 


The diagram on the right is the key to the transforms implied by the spatial relation¬ 
ship. Verify the following important groups. 


sincr FI(u) 

JM -"Hi - t} 2 )-'n{q) 


8{r - a) 

2 cos 27 mu 

2 a{a 2 - 

liraj q( 2.7t aq ) 


M(r) 

(1 - u 2 f — u 2 cosh 1 u 1 

sine 2 x 

Mfl) 


e - 7 " 2 

g-mi 1 

g—ax 1 

e -w 


38. Verify the composite similarity theorem for the Fourier-Abel-Hankel cycle of trans¬ 
forms, for a > 0: 



fir) 

F(u) 


«/W f(f) 

If 

%i x ) 

Cfo) 

then 

g(ax) 


39. Noncircularly symmetrical Fourier transforms. Establish the following two- 
dimensional Fourier transform pairs. 


/<*/«/) 

T(u, v) 

8{r - ay" 6 

(- i)”2-7rae in6 J„(2iraq) 

8{r — a) cos n8 

(—«)"27ro cos tuj) ]„(2iraq) 

8(r — a) sin n6 

(—i)"27rfl sin ruf> J n [2traq) 

8(r — a) cos 6 

- ilrra cos 4> h(2iraq) 

S(r - a) sin 6 

— ifora sin Ji(2iraq) 

n(^) cos 4S 

(2irq 2 )~ l cos 40[4 + 8fc(2iraq) + (2iraq — \2/naq)J^(2-iraq)] 
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40. Three-dimensional Fourier transforms. Establish the following three-dimensional 
Fourier transform pairs. 


fc(r) 

K(s) 

exp (-or) 

8na[a 2 + (2tts) 2 ] _2 

r' 1 exp (-or) 

+ (2-7TS) 2 ] -1 

r~ 2 exp (-or) 

•“■■(?) 

r-1 

(4ir)~ 1 s” 5/2 

r " 1 

W "V 2 

r -3/2 

s'* 2 

r 2 

ITS ' 1 

exp (-7JT 2 ) 

exp (-7rs 2 ) 

sine 2 r 


jincr = (2r)-‘/ I (7rr) 

2if' (1 - 4s 2 )- 1/2 n(s) 


41. Fourier transform in n dimensions. A function /(r) in n-dimensional space is a func¬ 
tion only of distance r from the origin, and its «-dimensional Fourier transform F(q) is 
a function of only one variable q. For n = 1,2, and 3 verify that the general formula 

m = J“ r"%_ 2)/2 (27 rqr)f{r)dr 

can claim to represent the n-dimensional Fourier transform. 


42. Cosine transform. A function/(x) is defined from 0 to oo by 

1 - lx 2 , 0 < x < j 
0, x > | 



Find its cosine transform F c (s) = 2/“ cos 27 rsxdx. t> 


43. A business transform. A stock market analyst is accustomed to take daily stock prices 
/(t) and to compute a transform 

F c ( v ) = T7 2 /( T ) cos (2-7Tvt/N), 0-SN-1 

Af t = _ n + 1 

with a view to discerning seasonal trends that are combined with other information to 
advise clients. Usually N is taken as 365 and the transformation is repeated monthly. A 
new idea requires modification of F c (v), followed by a reverse transformation, and you 
have been interviewed as a prospective consultant to supply the formula for the inver¬ 
sion. The nature of the processing of F c (y) and its purpose constitute proprietary infor¬ 
mation that has not been divulged to you. Take this assignment seriously; the financial 
compensation is very much higher than you are used to. Compose a competent pro¬ 
fessional report. t> 
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44. A transparent fiber made of silica is lightly doped with germanium dioxide so that the 
refractive index n has a value n 0 on the longitudinal z-axis but drops off with radius r 
according to n = m 0 (1 — t^/h 2 ), where h is a distance large compared with the radius of 
the fiber. The value of n 0 is only one or two percent larger than the value (around 1.55) 
for silica. A light ray having entered the fiber at r = 0, z = 0, makes an angle i with the 
z-axis. Show that the ray follows the sinusoidal curve 

2 L tan i . vz 
r =-sin— 

7T 2L 

where L = TTh/2\f2n Q is the distance from z = 0 to the first turning point of the ray. !> 

45. Inverse function. Show that the function l/7rr has as its convolutional inverse 

in the sense that (l/-jnr) * (-1 /ttx) = 8(x). 



The Laplace Transform 


Hitherto we have taken the variables x and s to be 
ever, let t be a real variable and p a complex one, and 


real variables. Now, how- 
consider the integral 


J —OO 


This is known as the (two-sided) Laplace transform of f(t) and will be seen to 
differ from the Fourier transform merely in notation. When the real part of p is 
zero, the identity with the Fourier transform (as interpreted with noncomplex 
variables) is complete. In spite of this, however, there is a profound difference in 
application between the two transforms. 

Alternative definitions of the Laplace transform include 


which may be referred to as the one-sided Laplace transform, and 

p j f(t)e~ pl dt, 

which may be referred to as the p-multiplied form. 

The one-sided transform arises in the analysis of transients, where /(f) comes 
into existence following the throwing of a switch at t — 0. However, if we deem 
that /(f) = 0 for t < 0, such cases are seen to be included in the two-sided defi¬ 
nition. It is not always stressed that the lower limit of the integral defining the 
one-sided Laplace transform is 0+; indeed in practice it is normally written as 0. 
One must remember that 

Too Too 

j o f{t)e pt dt usually means lim J f(t)e v dt. 
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Many writers have adopted the p-multiplied form for the sake of continuity 
with the operational notation of Heaviside, whose early success with the differ¬ 
ential equations of electrical transients stimulated long-continuing development 
in transform theory. The admittance operator Y(p), where p is interpreted as the 
time-derivative operator, turns out to be the p-multiplied Laplace transform of the 
response to a unit voltage step. 

The p-multiplied transform is now dying out, and so the connection with a 
good deal of electrotechnical and applied-mathematical literature has been dis¬ 
turbed. On the other hand, by omitting the p, one can have exact correspondence 
with the Fourier transform. Furthermore, one can preserve the compactness of 
routine operational solutions (which save a line or two), by dealing in terms of 
the impulse response instead of, as formerly, the step response. Thus in the opera¬ 
tional relation 


i(t) = Y(p)v(t) 

between an applied voltage waveform v(t) and a response current i(t), where p is 
interpreted as the time-derivative operator, Y(p) proves to be the not-p-multiplied 
two-sided Laplace transform of the response to a unit voltage impulse. This op¬ 
erational formula is often also true for the one-sided transform. 

The inversion formula for regaining f(t) from its Laplace transform has the 
sort of symmetry possessed by the inverse Fourier transformation. However, the 
variable p, unlike o), is normally complex, so that a contour of integration in the 
complex plane of p must be specified. Thus 

m = h f'l" d f■ 

foo 

where F L (p) = f(t)e pl dt, 

J “00 

and c is a suitably chosen positive constant. 

Advantages of the Laplace transform over the Fourier transform for handling 
electrical transient and other problems are often quoted in books. The essential 
advantage of the Fourier transform is its physical interpretability—as a spectrum, 
a diffraction pattern, and so on. Laplace transforms are not so interpretable, and 
once we take Laplace transforms of an equation we retain only a mathematical, 
not a physical, grasp of its meaning. 

In general, however, the Laplace transform is used for initial-value problems, 
such as transients in dynamical systems, and is not used at all in a broad class of 
problems included in the present work. 

For basic texts see Doetsch (1943) and van der Pol and Bremmer (1955), and 
for extensive lists of Laplace transforms see Erdelyi et al. (1954) and Roberts and 
Kaufman (1966). McCollum and Brown (1965) have provided an exhaustive com¬ 
pilation of transforms arising in electric circuit applications. 
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CONVERGENCE OF THE LAPLACE INTEGRAL 

The definition integral tells us that we are to multiply a given function f(t) by 
e~ pi , where p is any complex number, and integrate from — oo to +oo. If we con¬ 
sider for a moment only values of p which are real, we can graph the product 
f{t)e~ pl for a sequence of values of p (see Fig. 14.1). When p — 0, the product is 
equal to /(f) itself; hence the Laplace transform at p = 0 is equal to the infinite 
integral of /(f); that is. 


Fd o) = f 00 m *• 

The areas under the successive curves labeled p = —0.1, —0.2 give 
F l (-0.1), F l (- 0.2). Clearly, as p goes more and more negative, e~ pl represents an 
ever-larger factor by which the values of /(f) for positive values of f have to be 
multiplied. There may be a limit, as suggested by the figure, which p must ex¬ 
ceed if the integral is to remain finite. Let this limiting value of p be a. When p 
has an imaginary part, it can be shown that the integral will not be finite if the 
real part of p falls below this same real number a. Similarly, if positive real val¬ 
ues of p are considered, it is possible that the area under the product may become 
infinite to the left of the origin. Of course, if /(f) = 0 for t <0 this cannot hap¬ 
pen, nor can it happen if the definition integral is one-sided. But in general there 
will be a real number (3 which p may not exceed, and as before it can be shown 
in the complex case that the real part of p is what counts. 

Laplace transforms therefore may not exist for all values of p, and in the typ¬ 
ical case there is a range specified by 

or < Rep < /3 



Fig. 14.1 


The broken curves show e~ pt , and the full curves e pt /(f), for certain real 
values of p. 
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Imp 


Rep = a 



Rep 


Fig. 14.2 Complex plane of p showing the strip of convergence. 


in which the definition integral converges. This means that in the complex plane 
of p, convergence occurs in a strip (see Fig. 14.2). It is not necessary that conver¬ 
gence occur on the imaginary axis of p, as happens in the figure, or that it should 
occur at all. 

Consider, for example, /(f) = e 1 . This elementary function, widely used in cir¬ 
cuit analysis and other subjects studied by means of the Laplace transform, does 
not possess a convergent Laplace integral if Re p > 1, or if Re p < 1. In this case 
the strip of convergence has contracted to a line: the integral converges only where 
Re p = 1, and even then not exactly at p = 1. 

The function exp [fH(f)] would require Re p < 0 for the left-hand part of the 
integral to converge; but convergence of the right-hand side requires Re p > 0; 
hence there can be convergence for no value of p. On the other hand, exp [ -fH(f)] 
can converge on the right-hand side if Re p > -1, hence there is a strip of con¬ 
vergence such that -1 < Rep < 0. 

To summarize the convergence situation let us note that the left-hand limit a 
is determined by the behavior of the right-hand part of /(f). The more rapidly 
/(f) dies away with increasing f, the further to the left a may be, and if /(f) falls 
to zero and remains zero, or diminishes as exp (—f 2 ) then a recedes to — oo. 

Similarly, the right-hand limit /3 depends on the left-hand half of /(f), reced¬ 
ing to +00 if, for example, /(f) is zero to the left of some point. Examples illus¬ 
trating the various possibilities are given in Fig. 14.3. 


THEOREMS FOR THE LAPLACE TRANSFORM 

Most of the theorems given for the Fourier transform are restated in Table 14.1 
for the Laplace transform. To a large extent the theorems are similar, the main ad¬ 
ditional item concerning the strip of conveigence. 
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Fig. 14.3 Some simple functions and their strips of convergence. 
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■ TABLE 14.1 

Theorems for the Laplace transform 


Theorem 

/(») 

y{p) 

Strip of convergence 

Similarity 

fiat) 


a < a~ l Re p < P 

Addition 

m + m 

F,(p) + Fi(P) 

max (a^otj) < Re p < min 

Shift 

fit - r) 

e Tp F(p) 

a < Rep < P 

Modulation 

/(f) cos wt 

\F{p - Uo) + \F(p + iw) 

F(p + a) 

a < Re p < p 

n — Re a < Rep < p — Re a 

Convolution 

fM*m 

Fi(p)F 2 (p) 

max (a],a 2 ) < Re p < min (/3 x ,/3 2 ) 

Product 

mm 

1 ff + too 

9 ■ F,( S )F 2 (P-S)<& 

2.7TI Jc-ioo 

a l ^ a 2 ^ Re V < Pi + fils a l ^ c ^ Pi 

Autocorrelation 


F(p)F(~p) 

|Rep| < min (|a|,|j3|) 

Differentiation 

/'(*) 

PF(P ) 

a < Rep < p (often) 

Finite difference 

/(f + kr) 

- |t) 

2 sinh \rp F(p) 

a < Rep < p 

Integration 

[ /(«) du 

J — OO 

p-'Fip) 

max (a,0) < Re p < p 


\~mdu 

p'F(p) 

a < Rep < min {fi, 0) 

Reversal 

/(-o 

F(~P) 

~P < Rep < —a 


TRANSIENT-RESPONSE PROBLEMS 

Let a time-varying stimulus V\(f) elicit a response V 2 (t) from a linear time- 
invariant system. For example, V r 1 (f) might be the voltage applied to the input of 
a linear time-invariant electrical network, and V 2 (t ) might be the output voltage 
caused by V\(f). Then the relation between the two will often be conveniently ex¬ 
pressible in the form of a linear differential equation with constant coefficients: 

«oViW + «i £v,(t) + a 2 ^V,(t) + ... 

Such a differential equation is suitable for solution by the Laplace transformation. 
Multiply each term by exp (—pt) and integrate each term from -oo to oo. Then 

Co v x {ty-*dt + fll f 00 v'ify-p 1 dt+ ... 

J — oo J —oo 

= b 0 f°° V 2 (t)e~ pl dt + b x f “■ V^t)e~ pt dt + . ... 

J —OO J — OO 
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Using bar notation for Laplace transforms, that is, 

_ f oc 

Vi(p)= V^y-V'dt, 

J — oo 


and recalling that the Laplace transform of the derivative V[(t) is pV x (p), we have 
a 0 Vi{p) + + a 2 p 2 V t (p) + ... = b 0 V 2 (p) + fc,pU 2 (p) + b 2 p 2 V 2 (p) + .... 


This equation relating the Laplace transforms of V^t) and V 2 (t) is known as the 
subsidiary equation. It is not a differential equation; it is merely an algebraic equa¬ 
tion and may readily be solved for V 2 (p). Thus, where the denominator is not 
zero. 


Viip) - 


a 0 + a x p + a 2 p 2 + ... 
bo + btf + b 2 p 2 + ... 


Vi (P)- 


This simple step typifies the essence of transform methods. By translating a 
problem to the transform domain one gets a simpler problem. 

Tt will be found that partial differential equations in which there are two in¬ 
dependent variables, such as x and l on a transmission line, are reduced to ordi¬ 
nary differential equations. Simultaneous differential equations are reduced to si¬ 
multaneous algebraic equations, and so on. 

In the present case, by the act of solving the trivial algebraic problem, we have 
solved the differential equation. It only remains to retranslate the result into the 
original domain. 

If Vj(f) is a simple conventional stimulus, and we shall refer later to cases in 
which it is not, then its Laplace transform Vi(p) may be recalled from the mem¬ 
ory or from a small stock of transform pairs kept for reference. The reference list 
is eked out by theorems and one or two established procedures, for example, the 
expansion of ratios of polynomials in partial fractions. After calculating V 2 (p ) from 
Vi{p) by multiplication with the ratio of polynomials as indicated, one retrans¬ 
forms, by the same procedures, to find V 2 (f). 


LAPLACE TRANSFORM PAIRS 

It is rarely necessary to evaluate a Laplace transform by integration. Most fre¬ 
quently, the method is used on systems with a finite number of degrees of free¬ 
dom, for which a quite small stock of transform pairs suffices. The key pair is 

e D —-— —Re a < Re p. 

K ' p + a v 

Taking a to be zero, we have 

H{t) D - 
V 


0 < Rep. 



chapter 14: The Laplace Transform 
Taking a = ico, we have 

e~ iaU H{t) D 

and e**H(t) D 


p + id) 

1 


p — 10) 

Adding the last two pairs, we have 


0 < Rep 
0 < Re p. 


Ir/X 1 1 11 
cos cot H(t ) D —-:—h — 


2 p — ico 2 p + ico 

2 V . 2 0 < Rep, 

p Z + 


and subtracting, we have 


11 11 
sin cot H(t) D — 


2i p — ico 2 i p + ico 


co 


p 2 + 00' 


2 0 < Rep. 


By applying the integration theorem to H(t) D p 1 we find 

tH(t) D ~ 0 < Re p, 

V 

and the derivative theorem gives 

8(t ) D 1 — oo < Rep < oo. 

By the addition theorem, we have 

a 


(1 - e'^Hit) D 


max (0, —Re a) < Re p. 


p(p + a) 

By differentiating exp (—af)H(t) D (p + a) -1 with respect to a, we have 

1 




—Re a < Rep. 


(p + a) 2 

Splitting a into real and imaginary parts, a — cr + ico, we have 

1 


whence 

and 


f) D 

cos cot H(t) D 
e~ crt sin cot H(t) D 


p + o' ± ico 
p + a 

(p + cr) 2 + a> 2 

_ a) 

(p + cr) 2 + co 2 


—a < Rep, 
-cr < Rep, 
-cr < Rep. 
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* TABLE 14.2 

Some Laplace transforms 


m 

f” 

J -OO 

Strip of 
convergence 


1 

f-Rea < Rep 

— J 

p + a 

(Rep < -Rea 

m 

1 

P 

0 < Rep 

tH(t) 

1 

f 

0 < Rep 

m 

1 

all p 

m 

P 

all p 

(1 - 

a 

p(j> + a) 

max (0, — Re a) < Rep 

cos tot H(t) 

V 

p* + to 2 

0 < Rep 

sin wt H(t) 

(O 

p 2 + to 2 

0 < Rep 

te a ‘H(t) 

1 

ip + a) 2 

— Re u < Re p 

e~ a ' cos tot H(t) 

p + a 

{p + <x) 2 + cd 2 

—a < Rep 

sin tot H(f) 

£t> 

(p + a) 2 + to 2 

-er < Rep 

g-o|'l 

2a 

ct-p 2 

—Re a < Re p < Re a 

n (0 

sinh|p 

all p 

n(t - |) 

1 - e* 

V 

all p 

A(t) 

/anhjpy 

V \p ) 

all p 

IH(f)H(t + |) 

1 

1 - e~P 

0 < Rep 

>1(0 

sinh |p 

all p 

n(f) 

cosh |p 

all p 

-H(-t) 

1 

P 

Rep < 0 

sgn t 

2 

P 

Rep = 0 


coth|p 

0 < Rep 
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From the representative variety of familiar transient waveforms that are so 
readily derivable from 


e~ at H(t ) 3 


1 

p + a' 


it is clear that the exponential waveform plays a fundamental role. As shown else¬ 
where, exponential response to exponential stimulus is synonymous with linear¬ 
ity plus time invariance. All the time functions listed are thus inherent in linear 
time-invariant systems and may be elicited by simple stimuli. 

For reference, the examples are tabulated in Table 14.2, together with a few 
other examples that are characteristic of simple stimuli. These further examples 
may all be readily obtained by integration, or converted directly from the known 
Fourier transforms, by replacing ilirf by p. The strip of convergence has to be 
considered separately. 


NATURAL BEHAVIOR 

In the transient-response problem described above, the answer V 2 (t) Is the re¬ 
sponse elicited by the stimulus V^f). The system may also, however, be capable 
of natural behavior that requires no stimulus for its maintenance. Usually, some 
prior stimulus has been applied to the network to excite the natural behavior (but 
not necessarily; the system may have been assembled from elements containing 
stored energy). 

Evidently any natural behavior associated with the circulation of energy not 
injected by the stimulus V x (t) has to be added to V 2 (t) to give the total behavior. 

The well-known procedure for finding the natural behavior amounts to solv¬ 
ing for a response V 2 (t) when the stimulus V,(f) = 0. Thus putting V t (p) — 0 in 
the subsidiary equation, we have 

b 0 4- b r p 4 b 2 p 2 4 ... = 0. 

This is known as the characteristic equation, and it furnishes the set of complex 
roots A*, A 2 ,..., that define the natural modes of the system. 

A variation V 2 (t) = exp (A k t) will be seen on substitution in the differential 
equation to be a solution when V,(f) = 0. A simultaneous combination of all the 
modes, with arbitrary strengths, expresses the natural behavior in its most gen¬ 
eral form: 2* a k exp X k t, provided the roots A lr A 2 , . . . are all different. 

If there is a repeated root, say for example that A 3 equals A 4 , then nonexpo¬ 
nential behavior t exp A 3 f can occur. In a sense this is conceivable as a combina¬ 
tion of exponential modes as follows. Consider a system in which A 3 and A 4 are 
almost equal, and then consider a sequence of systems in which A 3 and A 4 ap¬ 
proach equality as attention progresses from one system to the next. The expres¬ 
sion 


4 a 4 e A< ' 
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denotes possible forms of behavior, where a 3 and a 4 are arbitrary strengths. Let a 3 
be equal to a 4 in magnitude, but opposite in sign. Let A 4 = A 3 + 8A. Then the ex¬ 
pression above becomes 

a 3 [e 

which describes a humped waveform, rising from zero and than falling back; but 
as 8A approaches zero the expression also goes to zero. Since, however, the coef¬ 
ficients a k are arbitrary, and the modes may be evoked in any strength, we are 
quite entitled to amplify the faint behavior as 8A diminishes. Suppose that as we 
move from system to system we make the coefficients a 3 and a 4 increase in inverse 
proportion to SA. Then a sequence of possible behaviors is 

g(A 3 + «A)f _ pA,t 

SA ' 

an expression which in the limit is the derivative of exp A 3 t with respect to A 3 . 
Therefore, in the limiting system, where A 4 is equal to A 3 , 

te *' 1 

is a possible time variation and any multiple thereof. It might seem that the merg¬ 
ing modes would have to be hit extremely hard in order to produce this result, 
but in fact only a finite amount of energy is required. Hence, if repeated roots oc¬ 
cur, derivatives of exp A k t with respect to A k must be included in the expression 
for the most general natural behavior. 


IMPULSE RESPONSE AND TRANSFER FUNCTION 


Let V 2 (t) = 1(f) when Vft) = 8(t), irrespective of the choice of the origin of t. Then 
I(t) may be called the impulse response, and by the superposition property, 

V 2 (t)= f 00 IMV^t-u'fdu. 

J —oc 

Now if Vi(t) is an exponential function, 

Vi(t) = 

where p is some complex constant, it follows that 

V 2 (t) = f“ I(u)e pll ~ u) du 

J “OC 

= du^e*. 

The result shows that the response to exponential stimulus is also exponential, 
with the same constant p, but with an amplitude given by the quantity in brack¬ 
ets. We call this quantity the transfer function, and it is seen to be the Laplace trans- 
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form of the impulse response. From the subsidiary equation given earlier we see 
that the transfer function is 

a 0 + a x p + a 2 p 2 + ... 
b 0 + + b 2 p 2 + . •. ’ 

For lumped electrical networks, one can write the transfer function readily 
from experience with calculating a-c impedance. Hence, through the Laplace 
transformation, the impulse response also becomes readily accessible. Thus in the 
circuit of Fig. 14.4, the ratio of V 2 (t) to V^f) when V,(f) varies as exp pt is, by 
inspection, 


R 4- L 2 p 


R- 


R + L 2 p 


Cp 


Lip 


(R + L 2 p )— R + (Li + Lj)p + L^RCp 2 + L^L 2 Cp 3 

2 C P 


R + L 2 p + — 


By the method of partial fractions, this ratio of polynomials can be expressed in 
the form 

ABC 

- 1 -- -|- 

p + a p + b p + c 

and thus the impulse response is 

(. Ae~ m + Be bt + Ce~ c, )H(t). 


In problems where V 2 (f) must be found when Vj(f) is given, two distinct 
courses must always be borne in mind: one is to proceed by multiplication with 
the transfer function in the transform domain; the other method is to proceed, by 
use of the impulse response, directly through the superposition integral. 

A strange difference between the two procedures may be noted. The super¬ 
position integral 

f OO 

V 2 (ti) = /(w)V\(fi - u) du 

J — OO 


L, L 2 



T 


V 2 (t) 


I 


Fig. 14.4 Find V 2 (t) when Vj(f) is given. 
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does not make use of values of Vj(f) for f > fj during the course of calculating 
V 2 (fx)- (This is clear because of the fact that the integrand vanishes for negative 
values of u.) In other words, to calculate what is happening now, we need only 
know the history of excitation up to the present moment. 

But the procedure in the transform domain normally makes use of informa¬ 
tion about the future excitation. Indeed, to calculate the Laplace transform of the 
excitation V,(f) we have to know its behavior indefinitely into the future. 

As a rule, one obtains the same result for the response at t = f, irrespective 
of what V^f) does after tj passes, but occasional trouble can be expected. For ex¬ 
ample, it is perfectly reasonable to ask what is the response of a system to 
Vi(t) = exp t z [H(t)], and the superposition integral gives it readily, but the Laplace 
integral diverges because of troubles connected with tire infinitely remote future. 
One way out of this dilemma is to assume that the excitation is perpetually on 
the point of ceasing; in other words, assume an excitation exp t 2 [H(f) — H(f — t a )]. 


INITIAL-VALL)E PROBLEMS 

Various types of initial-value problems may be distinguished. One type represents 
the classical problem of a differential equation plus boundary conditions. Thus 
the driving function is given for all 1 t > 0, but no information is provided about 
the prior excitation of the system. Consequently, some continuing response to 
prior excitation may still be present, and therefore extra facts must be furnished. 
The number of extra facte is the same as, or closely connected with, the number 
of modes of natural behavior, for the continuing response may be regarded as a 
mixture of natural modes excited by a stimulus that ceased at t = 0. Thus suffi¬ 
cient facts must be supplied to allow the strength of each natural mode to be 
found. These data often consist of the "initial" response and a sufficient number 
of "initial" derivatives. The word "initial" refers to t = 0+; the value at t = 0, 
which may seem to have more claim to the title, is frequently different. To deal 
with this problem, calculate the response due to a stimulus V^(t) that is equal to 
zero for — oo < t < 0, 2 and equal to the given driving function for t > 0. 3 Of the 
many possible particular solutions of the differential equation, this one corre¬ 
sponds to the condition of no stored energy prior to t = 0. At t = 0+, this re¬ 
sponse function and its derivatives possess values that may be compared with the 
initial data. If they are the same, then there was no stored energy prior to t = 0, 
and the solution is complete. But if there are discrepancies, the differences must 


1 The exciting function l/j(t) is given sometimes for f 2 0 and sometimes for t > 0, but the statement 
of the problem, as in the example that follows, often does not say which. 

2 In this statement -do means a past epoch subsequent to the assembly of a physical system which 
has since remained in the same linear, time-invariant condition. 

3 At t = 0, take a value equal to j V(0+); or take any other finite value, since, as previously seen, there 
is no response to a null function. 
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be used to fix the strengths a k of the natural modes by solving a small number of 
simultaneous equations of the form 

y 2 (o+) = 2 

k 

V&0+)= 


A much better method, which injects the boundary conditions in advance, de¬ 
pends on assuming that the response, not the stimulus, is zero for t < 0. Let it be 
required to solve the differential equation 

b 0 v 2 (t) + bfnt) + b 2 vm + ... = v,(t) 


for V 2 {t), given V t (t) for t > 0, and the initial values V 2 (0+), V 2 (0-i-), .... The cir¬ 
cumflex accents indicate that the functions are undefined save for positive t. We 
replace the differential equation by a new one for V 2 (t) where 


V 2 (t) = 



t > 0 
t < 0. 


The function V 2 (0 is thus defined for all t, and agrees with V 2 (t), where the latter 
is defined. Since 


v &) = v 2 (o+)«(t) + {^ (,) | > 

and V'{{t) = V 2 {0+)S(t) + P 2 (0+)fi'(f) + 

the new differential equation is 

b 0 V 2 (t) + b 2 V' 2 (t) + b 2 V" 2 (t) + ... = V,(f), 
where V a (t) = [b l V 2 (G + )8(t)] + [b 2 V' 2 {0+)8{t) + & 2 V 2 (0+ )«'(*)] 



0 

0 

iV" 2 (t) t > 0 
\0 t < 0, 


t > 0 
t < 0. 


This differential equation differs from the original one by the inclusion in the dri¬ 
ving function of impulses necessary to produce the initial discontinuities of V 2 (t) 
and its derivatives. Taking Laplace transforms throughout, we have the subsidiary 
equation 

b Q V 2 (p) + btfV 2 (p) + btfPV^p) + ... = V x (p). 


Thus 


V 2 (p) = 


V, (p) 


b 0 + b x p + b 2 pi 1 + ... 
[biV 2 { 0+)] + [b 2 VW+) + b 2 V 2 (0+)p] + ... + 


o °° + V a (t) e~*dt 


b 0 + b x p + b 2 p 2 4- ... 
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Inversion of this transform to the time domain gives V 2 (t); and the part of it 
referring to t > 0 gives the desired solution V 2 (t), with built-in satisfaction of the 
initial conditions. 

Consider the following example: Given the differential equation 


d 2 y 3 dy 
dt 2 dt 


+ 2y = 2, 


solve for y(f) (t > 0), subject to the initial conditions y(0) =* 1 ,y'(0) - 0. (Although 
this is customary notation, y(0) really stands for y(0 + ), as we have noted.) It may 
be observed that the driving function is 2, independent of time. However, it is not 
explicitly stated whether the driving function is equal to 2 for t > 0, or for t > 0. 
Let 


V(0 = {f 

as shown in Fig. 14.5. Then 

no = y(0+)«(f) + |^ (,) 

and y-(()=y'(0+)S(0 + y(0+) 

and the new differential equation for Y(f) is 

Y"(f) + 3Y'(f) + 2Y = 8’(t) + 35(f) + 2 H(t). 

The subsidiary equation is 

fnp) + 3 pY(p) + 2 Y(p) 

whence Y(p) 

V 

and hence Y(f) = H(f) for all f. 

Thus finally, for the limited region f > 0, the desired solution is 

y(t) = i. 

It is now instructive to study this example from the standpoint of investigat¬ 
ing the prior excitation, which was not divulged in the statement of the problem, 
and in lieu of which the initial conditions were given. For the sake of concrete¬ 
ness, let it be observed that 


= P + 3 + (2/p), 
_ V + 3 + (2/p) 
p 2 + 3p + 2 
1 


t > 0 
t < 0, 


t > 0 
t < 0 


S'(f) + 


t 


(t) 


t > 0 
t < 0, 


L 


^9 

dt 2 


<*Q 

+ R~r 
dt 



= V(t) 
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Response function 
y(t) 

New 

response function 
Y(f) 





t t 


Driving function 
2 


t 


New 

driving function 


i5 , (0 + 36(0 + 2H(f) 


Fig. 14.5 An initial-value problem (left) and its equivalent (right). 


is the differential equation for the charge Q on the capacitor of a series LRC cir¬ 
cuit across which there is a voltage V(t). If L = 1, R = 3, C -1 = 2, we deduce from 
the previous work that a Q of one coulomb, constant for f > 0, is compatible with 
an applied voltage of 2 volts (t > 0), and with the conditions Q(0 + ) = 1 and 
Q'(0+) = 0. 

Unless the circuit was assembled from elements with energy stored in them, 
the capacitor charge must have been drawn from the voltage source. We can eas¬ 
ily find what the voltage source must have done by making some simple suppo¬ 
sition. Suppose, for example, that the charge was placed instantaneously at t = 0; 
that is, take 

<2(0 = H(t). 

Then, from the differential equation, 

V(t) = S'(t) + 36(f) + 2 H(t). 

The impulsive parts force a current impulse through the inductance and resis¬ 
tance, placing the charge on the capacitor, and the voltage step holds it there. 

We have just solved a problem in which a complete history of excitation is 
given and no supplementary initial conditions enter. By now suppressing the in¬ 
formation about the drastically impulsive behavior of V(t) at f - 0 and introduc¬ 
ing in its stead the fact that at t = 0 + the capacitor was seen to be already charged, 
with zero rate of change, we return to the original problem. 

There are many other ways in which the capacitor could have been given its 
initial charge. In particular, in this problem, the charging could have been done 
in the same way but earlier, as described by 

Q(t) = H(t + 1) 

V{t) = 8'(t + 1) + 36(t + 1) + 2H(t + 1). 
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The positive-1 part of these quantities would also satisfy the initial-condition prob¬ 
lem, but Q(0) and V(0) would not be the same as before. 

The peculiarity of the systematic method given for incorporating initial con¬ 
ditions is that impulsive terms are added to the driving function so as to inject 
all requisite initial energy instantaneously at t = 0. 


SETTING OUT INITIAL-VALUE PROBLEMS 


When the principle of the Laplace transform solution is understood, fewer steps 
in setting out are required. From the differential equation and initial conditions 
the subsidiary equation is written directly by inspection. Thus, given 


d 2 y 3 dy 
dt 2 + dt 


+ 2 y = <p(f). 


we write 


P 2 o y(p) + 3 p 0 y{p) + 2 0 y{p) = [y'(0+) + y(0+)p] + [3y(0+)] + Mpl 


where 

and 


_. . \y{t) t > 0 

c (o t < 0, 
, r*p(o t > o 

^ )C V ^<0 


Since these transforms refer to functions that are zero for t < 0, they are equal 
to the one-sided transforms of the functions y(t), <p(t). Early emphasis on this type 
of problem accounts for the prevalence of the one-sided transform. 


SWITCHING PROBLEMS 

Two types of problems have been described which are suited for handling by 
Laplace transforms: 

1. Transient response of a linear, time-invariant system to a driving function given 
for all t (includes problem of natural behavior on taking driving function to be 
zero). 

2. Initial-value problems where information on the driving function for t > 0 is 
supplemented by initial data regarding the response. 

In a third type of problem the time invariance is violated in a simple way by 
switching. It is important to realize that throwing a switch changes an electric cir¬ 
cuit to a different circuit, as regards application of the linear, time-invariant the¬ 
ory. For example, when switching places a battery voltage across a resistor, a new 
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circuit comes into existence. This simple switching problem is quite different in 
kind from the transient-response problem in which a voltage source in series with 
a resistor develops a voltage H(f). It is true that in each case a step function of 
current flows in the resistor, but the second case involves a time-invariant circuit 
whose resistance is the same before t = 0 and after t = 0. There is an equivalence 
between the two problems, but only the second is amenable to the treatment al¬ 
ready given for linear, time-invariant systems. 

Of course, after the switch is thrown, both systems are identical. Consequently, 
if initial values of response are furnished ("initial" means after the switch has 
closed), together with details of the subsequent excitation, if any, the problem can 
be handled as an initial-value problem; for in those problems one does not in¬ 
quire into t < 0. 

More commonly, however, preinitial conditions (at t = 0-) are furnished, or 
the previous history of excitation is given. The technique for handling switching 
problems is to convert to an equivalent problem concerning a time-invariant cir¬ 
cuit, as in the simple case of the battery and resistor. 

A voltage V^t), given for all t, is applied to a circuit; at t = 0 an open switch 
somewhere in the circuit closes. To find the response V 2 (t), at some place, we can 
proceed as before for times preceding the throwing of the switch. We could also 
easily calculate what the response to V\(f) would have been if the switch had al¬ 
ways been closed. In fact we expect that this response will become apparent af¬ 
ter the switch has been closed long enough, and the circuit has "forgotten" the 
effects of the preswitching excitation. To find the response during the transition 
following t — 0 is the present problem. 

Across the terminals of the open switch a certain voltage exists, and it could 
be calculated as a transient response to the given driving function V,(t). Let it be 
V s (t). If a voltage source having zero internal impedance were connected across 
the switch, and if its voltage varied in exact agreement with V s (t), no current 
would flow in it. Since no current was flowing through the open switch, the volt¬ 
age source could thus be connected without disturbing the behavior of the cir¬ 
cuit. An important change has, however, been effected, for the zero-impedance 
connection now introduced across the switch has brought the circuit, for negative 
values of time, into identity with the circuit which was to be created at t = 0 by 
throwing the switch. The throwing of the switch can be fully simulated by the in¬ 
troduction of a voltage source V s (t)H(-f). This can be split into two terms 
V s (t) — V s (t)H(t). The response associated with the first term is already known; it 
is the response, for all t, of the open-switch system to (The superposition of 
the responses of the closed-switch system to V x (t) and V,(t) would give the same 
result.) The response associated with the second term, -V s (t)H(t), gives the de¬ 
sired transition term that has to be added to the response of the open-switch sys¬ 
tem to get the answer to the problem. 

In problems where a switch is opened and any current through it thereby in¬ 
terrupted, one applies the principle of duality and introduces a suitable current 
generator. 



398 


The Fourier Transform and Its Applications 


BIBLIOGRAPHY 

Doetsch, G.: "Theory and Application of the Laplace Transformation," Dover Publications, 
New York, 1943. 

Erdelyi, A., ed.: "Tables of Integral Transforms," McGraw-Hill, New York, 1954 

McCollum, P. A., and B. F. Brown: "Laplace Transforms, Tables and Theorems," Holt, Rine¬ 
hart and Wilson, New York, 1965. Provides a well-organized list of ratios of polyno¬ 
mials with denominators up to degree 5 and their transforms. 

Roberts, G. E., and H. Kaufman: "Table of Laplace Transforms," W.B. Saunders, Philadel¬ 
phia, 1966. 

van der Pol, B., and H. Bremmer: "Operational Calculus Based on the Two-sided Laplace 
Integral," Cambridge University Press, Cambridge, UK, 1955. 


PROBLEMS 

1. State the strip of convergence for the following functions: 

H(t) n(f) exp(-f*)H(f) (1+f 2 )- 1 
(1 + l 3 )- , H(t) (log f)H(f) sgn t r l im 
r 1 S ( f ) (1 + e *) -1 (1 + f 3 )” 1 

2. Find the Laplace transforms of the following functions, stating the strip of convergence: 

(e-‘ - e')H(f) *-« (e 1 - e-')H(-f) 

3. Derive the Laplace transforms of FI(t), FI(t - \), and A(f), stating the strip of conver¬ 
gence. O 

4. Find the current that flows in a series-LR circuit in response to a voltage exp ( —|f|). 

5. From one coil, one capacitor, and one resistor, 17 different two-terminal networks can 
be made. Tabulate the step and impulse responses of all these. O 

6. Find the current in a series-LR circuit in response to a voltage exp (f) sin t H(t). 

7. A current impulse passes through a series -LR circuit. What is the voltage across the cir¬ 
cuit? 

8. The input impedance to a short-circuited length of cable is 75 tan (10 -8 /). A voltage 
generator of zero internal impedance applies an impulse. What current flows in re¬ 
sponse? t> 

9. A voltage sin cot H(t) is applied to a series-LR circuit. Show that the response current is 

Lwe~ R>,L — Leo cos iot + R sin cot 
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10. A voltage cos wt H(t) is applied to a series-RC circuit. Show that the response current 
is 


Rtu 2 C 2 cos cot - tuC sin cot + R l e l/RC 
1 + cj 2 C 2 R 2 


H(t). > 


11. A voltage exp (— at)H(t) is applied to a series-LR circuit. Show that the response current 
is 


"«* - e~ R,/L 
R-aL 


H(t). 


12. A series-LR circuit is shunted by a capacitor C, and a ramp voltage tH(t ) is applied. 
Show that the response current is 


C + 


R 


L L 
R 2 + R 2 * 


—Rt/L 


H(t). 


13. Alternating voltage drives d.c.. An alternating voltage sin tut H(t) is applied to a cir¬ 
cuit, and direct current is observed. What is the circuit? t> 


14. Battery delivers alternating current A steady voltage is applied to a circuit, and a cur¬ 
rent sin cut H(t) results. What is the circuit? D> 

15. A capacitor C carries a charge Q. At t = —la switch is closed, allowing the capacitor to 
discharge through a resistor R. At t = 0 the switch is opened. Make a graph showing 
the current flow during the interval -2 < t < 1. 

16. A resistor and an uncharged capacitor are connected in parallel to form a two-terminal 
network. At t = —la battery is switched across the network, and at t = 0 the switch is 
opened. Find the current in the resistor and capacitor for all t. 

17. The voltage source applies a voltage exp (t)H(t) (see Fig. 14.6). At t = 1 the switch 
closes. Find the current through the voltage source during the interval — oo < t < oo, 
assuming the capacitor to have been initially uncharged. 

18. At t = — 1 capacitors Q and C 2 of Fig. 14.7 were seen to be discharging through the cir¬ 
cuit containing the resistor R. At t = 0 the switch closed. Find the current through C\ 
for all t. 



Fig. 14.6 
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Fig. 14.7 



19. Solve the following differential equations for y(f)(f > 0), subject to initial values y(0 +), 

y'{ o+). 

(a) y'(t) + y(t) = 1 

Answer: y = 1 + [y(0+) - l]e - ' 

(b) y"(f) + 5y'(f) + 6y(f) = 6 

Answer: 1 + [3y(0+) + y'(0 + ) - 3]e~ 21 + [2 - y'(0 + ) - 2y(0+)]<T 3 ' 

(c) y"(f) + 2y'(f) + y(f) = 2 sin f 

Answer: y = [1 + y(0 + ) + y'(0-t-)]fe ‘ + [1 + y(0 + )]e’ f - cos f 

20. For each of the above problems derive an electric circuit obeying the same equation. 
Deduce driving functions for all t that would produce the responses quoted for t > 0. 

21. Strip of convergence. Find four different time functions all having 
[( p ~ 2)(p — 1 )(p + l)] -1 as their Laplace transform. For each time function state the 
strip of convergence. t> 


22. Show that the Laplace transform of the staircase function H(t) + H(f - T) + 
H(f — 2T) + ... is given by 


1 

P(1 - e^) 


0 < Rep. 


23. A voltage v(t)H(t) is applied to a circuit that already contained energy before t = 0. As 
no information about the stimulus has been suppressed, no compensating postinitial 
data are needed. However, in order to get the total behavior /(f) it will be necessary to 
know about the natural behavior that is going on independently. It may be that the f ull 
history of earlier energy injection is unavailable, but it will suffice to know the situation 
immediately prior to the application of the voltage at f = 0 For example, the energy 
stored in each inductor and capacitor at f = 0— might be given; but suppose here that 
a sufficient number of preinitial values of the behavior are given: /(0-),/'(0-), 
• Show that the total behavior can be conveniently calculated by means of 
a special form of the Laplace transform defined by 


F-(P)= IZme^dt. 


Work out the theorem for this transform, deducing, for example, that the derivative 
theorem is /'(f) D pF_(p) - /(0-). > 
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24. Convergence of Laplace integral. Find the region of convergence of the Laplace trans¬ 
form of r i H( t — 1). 

25. Applying two-sided LT to initial value problem. Show how to solve y + y - 0 subject 
to initial condition y = y(0 +) by the two-sided Laplace theorem. C> 

26. One-sided Laplace transform. A series LR circuit obeys the differential equation 

Lift) + RI(t) = V(t). 

Find out what current flows when the voltage is turned on at t = 1. Assume that no 
stored magnetic energy was previously present. O 

27. Decaying echo train. The impulse response of a certain system is a regular train of im¬ 
pulses of exponentially decaying strength. Calculate the transfer function. t> 


28. Short-circuited transmission line. The input impedance to a two-terminal network is 
iR tan lirTf. Show that the current that flows in response to an applied voltage impulse 
is 


m = R-y(t) + 2^ 

and that the step response is 

A(t) = R' H(t) + 2 2 
i 


S(t - 2nT) 


H(t - 2nT) 


29. Triggered clock-pulse generator. The network of the previous problem is placed in 
parallel with a resistance R. Show that the current that flows in response to a voltage 
impulse is given by 


l{t) = 2/C , ]£S(f - 2 nT). 
o 


30. A suspicious transform. Authors listing Laplace transform pairs often indicate that 
HI(t)H(f) has Laplace transform coth \p, (0 < Re p). The corresponding Fourier trans¬ 
form is coth ji to or —i cos vf, which is an odd function off. Now III(t)H(f) is not an odd 
function, having an even part as well as an odd part. Therefore the implied Fourier pair 
cannot be correct, (a) Show that when the missing even part of the Fourier transform is 
included, the correct Fourier transform pair is III(f)H(f) D jIII(/) - i cot irf. t> 




Photo A The Microwave Spectroheliograph. 

The antenna array illustrated achieved a beamwidth of 3.1 arcminutes (Bracewell, R. 
N. and G. Swarup, "The Stanford Microwave Spectroheliograph Antenna, a Microstera- 
dian Pencil Beam Interferometer," IEEE Trans. Ant. Propag., vol. AP-9, pp. 22-30, 1961) 
and was used for making daily temperature maps of the Sun at a wavelength of 9.1 cm 
for 11 years. The east-west arm, comprising 16 steerable 3-m paraboloids on equatorial 
mounts spaced d = 7 .5 m is representable as a convolution between the aperture distrib¬ 
ution over a single paraboloid and the configuration function \\\{x/d)E\{x/\6d )S(y), 
whose two-dimensional Fourier transform is lbd 2 lll(dl) * sine Ibdl. Signals received from 
the Sun by the two arms are multiplied together; hence by the convolution theorem, the 
field reception pattern is proportional to [III(d/) * sine 16dl][UI(d?n) * sine 16 dm]. By this 
clear Fourier-based reasoning we see that the overall pattern consists of a sharp beam of 
the form sine 16 dl sine 16dm pointed at the zenith, each such beam being replicated in a 
square pattern of spacing \/d, or 42 arcminutes. From beam center to the first null is 
A/16d or 2.6 arcminutes. 

In another Fourier approach to analysing the antenna pattern, each arm configura¬ 
tion may be broken into pairs of the form 2[5(x + \ n d) + 8(x — ^nd)], n = 1, 3,5, 7. 
Then the pattern is seen as the sum of four cosines that directly express the full pattern 
of one arm, including replication. In a subsequent development, the east-west arm was 
combined with a second interferometer extending a further 51 m to the west, to reduce 
the beamwidth to 50 arcseconds, as demonstrated on the radio star Cygnus A, thus tak¬ 
ing the angular resolution of an antenna system beyond the visual acuity of the human 
eye. 

For correct adjustment, the waveguide transmission lines from each antenna to the 
central junction need to be equal to ±1 mm in an overall distance of 51 m, or 2 parts in 
10 5 , a precision characteristic of geodetic survey. To achieve this in an environment of 
varying temperature and humidity a fluorescent tube was placed in the feed horn of 
each antenna and switched on and off at 400 Hz to produce ionization capable of reflect¬ 
ing a faint modulated echo back to a central signal generator. Drifts in the phase path to 
any individual antenna could then be measured in the presence of strong unmodulated 
reflections from the branched waveguide system as a whole. This technique (G. Swarup 
and K. S. Yang, "Phase Adjustment of Large Antennas," IEEE Trans. Ant. Propag., vol. 
AP-9, pp. 75-81,1961) is the ancestor of various later related means for automatic 
phase-calibration and adjustment and is analogous to the development of telescopes 
with adaptive optics. 

From the punched-tape output of the receiver a teletypewriter displayed a real-time 
sun map that was distributed by telephone. An analogue optical-electronic device pro¬ 
vided the spherical trigometrical data for the day that controlled the varying declination 
and time of start required for successive rows of the sun map. The system was the first 
radio telescope to produce its output in camera-ready publishable form. 
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Photo B A Five-Element Radio Telescope. 

Five equatorially mounted paraboloids, 18.3 m in diameter, spaced in units of 
D ~ 22.9 m, combine to produce fan beams with east-width beamwidth of 18.8 arcsec- 
onds at a wavelength of 2.8 cm (Bracewell, R. N., R. S. Colvin, L. R. D'Addario, C. J. 
Grebenkemper, K. M. Price, and A. R. Thompson, "The Stanford Five-Element Radio 
Telescope," Proc. IEEE, vol. 61, pp. 1249-1257, 1973). The fan beams are spaced 4.2 arc- 
minutes. Earth rotation causes radio sources that are in the 7 arcminute beam to be 
scanned by the fan beams. The fan beams remain stationary on the sky in planes parallel 
to the meridian even as the antennas track the radio source, because the configuration 
function 8(x — D) + 8(x - 2D) + 8(x — 3D) + S(x — 7D) + 8(x — 10D) is stationary. 

The scanning angle changes in time allowing the brightness distribution over a source to 
be mapped, as in tomographic reconstruction. 

When a source is well away from the meridian the inequality of path differences of 
waves arriving at the different antennas would cause the fan beams to be smeared out 
because of the substantial bandwidth of 60 MHz that is utilized to increase sensitivity. 

To compensate, variable delay lines of effective length up to 100 m are incorporated in 
the transmission lines leading the received signals to a central system of ten multipliers 
that generate the complex correlation between the fields received at the ten possible 
spacings between pairs of elements. Fourier transformation of the correlation brings the 
data into the space domain in preparation for map reconstruction. 

The irregular spacing of the 5 antennas provides for all 9 spacings from D up to 9D 
without incurring the cost of providing a uniformly spaced array of 10 elements. The 
autocorrelation of the configuration function will show how the chosen arrangement 
minimizes the redundancy associated with the uniformly spaced array of the same over¬ 
all length. 
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Photo C A Radio Astronomical Image. 

A triumph of Fourier synthesis, this image of Cassiopeia A, one of the first radio 
"point" sources to be discovered in the 1940s, shows the angular diameter to be just un 
der b.arcminutes. The observations were carried out with the Very Large Array of the 
National Radio Astronomy Observatory at Socorro, New Mexico. The 27 movable 25-m 
antennas are arranged in a variety of Y configurations extending up to 21 km in order to 
measure the two-dimensional complex correlation function that is the Fourier transform 
of the desired brightness distribution. At a resolution of 0.2 arcseconds and very high 
dynamic range, the quality of the radio "image" cannot be matched by optical reproduc¬ 
tion on tilm. 

The object is the remnant of a supernova explosion that occurred in AD 1680. Its an¬ 
gular diameter has been (measurably) increasing, but as the expanding shell is slowed 
down by interstellar gas and dust its expansion has slowed. Consequently, interior mate¬ 
rial that was not in the forefront of the explosion has been able to overtake the shell and 
punch through, leaving crater-like pits over the surface. 
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Photo D Tomogram of the Human Head. 

This striking image of a thin sagittal slice through a human head in the (x,y)-plane 
was acquired, without the use of surgery, in the Medical Resonance Imaging (MKJ) 
group of the Electrical Engineering Department at Stanford University and kindly pro¬ 
vided by Dr. John Pauly. 

Grey levels correspond to the density of hydrogen atoms in the various tissues. 

Thus air spaces appear black, since they contain no water; bones and teeth appear black 
for the same reason. Fat, on the other hand, composed of hydrogen-rich molecules, ap¬ 
pears bright, as seen surrounding the skull, which is black, while muscle and brain 
show various grey levels according to their content of water and organic molecules. The 
thin layer of skin overlying the subcutaneous fat can be seen faintly. The conspicuous 
crinkles in the fat are due to contact with a pillow. 

The protons of the hydrogen atoms emit the signals from which the image is con¬ 
structed. In the presence of a steady magnetic field B p , a proton, if its spin axis is per¬ 
turbed, tends to recover by processing at a frequency yB n ; for example, in a field of one 
tesla, the precession frequency is 42.58 MHz. The factor y is the gyromagnetic ratio of 
the proton. In the course of precessing in the one-tesla field the proton loses energy to 
radio-frequency emission at 42.58 MHz that is readily detectable by a radio receiver. Per¬ 
turbation of the proton spin in the presence of a uniform field B 0 is produced by irradia¬ 
tion with the frequency yB v . All the protons in the object to be imaged will respond but 
attention can be confined to the content of a single thin slice centered on say z = 0 if the 
imposed magnetic field has a gradient G z measured in Tm _l in the z-direction. Then the 
emission from any one slice perpendicular to the z-axis can be selected with a narrow- 
band radio receiver tuned to y(B 0 4 G z z). The exciting pulse must now be brief enough 
to spread over the required frequency range. 

Let the complex time-varying pulse representing the total radiation in the frequency 
band y(B 0 + G x x) corresponding to the volume of interest be s(t). Then if the density of 
protons in the (x,y)-plane is M(x,y), 


s(f) = J | M(x,y)c-‘ 27ryC ' h dxdy, 

which is the value of the Fourier transform of M(x,y) at frequency yG x t. If we allow G v 
to vary with time, and add another linearly varying field G y for the y-axis, the transform 
can be traced out. ITiis example used a raster scan, where 256 separate lines of the trans¬ 
form were acquired sequentially, but other trajectories in transform space, such as he¬ 
lices, spirals or spokes, defined by varying the gradients appropriately, are also used, es¬ 
pecially where volumetric imaging for subsequent display plane by plane is practiced. 
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Antennas and Optics 


.Antenna theory is sufficiently analogous to the theory of waveforms and spec¬ 
tra that familiarity with one field can be carried over to the other, once one has 
the key. The first step is to establish a Fourier transform relation in this subject 
and then to see what the physical quantities are that enter into it. Since our pur¬ 
pose is to improve the versatility of the Fourier transform as a tool, only one as¬ 
pect of antenna theory is touched on, but it is of fundamental and far-reaching 
importance in thinking about antennas. 

We approach the subject by considering one-dimensional apertures. This may 
seem inappropriate, because the essence of antenna theory is that a higher di¬ 
mensionality is required than suffices for the study of waveforms, which are func¬ 
tions of only one independent variable. The one-dimensional treatment is ade¬ 
quate, however, for discussing a great many antennas whose directivity is 
separable into a product of directivities of one-dimensional apertures, and it is 
sufficient for setting up the analogy. Features of the two-dimensional theory are 
introduced later. 

Much of the material of this chapter is directly applicable, with changes in 
terminology, at optical as well as at radio wavelengths; thus the parallel light in¬ 
cident on an aperture is diffracted into space in much the same way as radio emis¬ 
sion from an aperture which is of the same shape (but larger, in proportion to its 
wavelength). In one class of problem an irradiating field, optical or radio, is given, 
but the aperture illumination is not specified explicitly. It is often sufficient to as¬ 
sume that the illumination that an incident wave produces in an aperture in a 
screen is the same as would have been produced if the screen had not been there, 
but since these more subtle questions of diffraction theory are not to be consid¬ 
ered here, our point of departure is the aperture distribution itself. In radio the 
excitation of an aperture, both in amplitude and in phase, may be directly im¬ 
posed by separate transmission lines leading to an array of closely spaced dipoles, 
a possibility that does not exist at optical wavelengths. For this reason it seems 
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appropriate for a discussion of diffraction from given aperture distributions to be 
couched in terms of antennas. 


HI 

ONE-DIMENSIONAL APERTURES 

An electromagnetic horn feeding energy into semi-infinite space, as shown in Fig. 
15.1, is an example of a type of antenna which can conveniently be replaced by a 
plane-aperture model. As far as the flow of energy into the right-hand half-plane 
is concerned, we may say that the source is equivalent to a certain distribution of 
electric field over an aperture plane AA'. The field is zero over the part of the 
plane occupied by conductor, but some definite distribution is maintained over 
the horn opening by the source of electromagnetic energy. 

Suppose that all conditions are independent of y, the coordinate perpendicu¬ 
lar to the plane of the paper. Then the antenna will be called a one-dimensional 
aperture. It is also supposed in most of what follows that the opening is at least 
several wavelengths across. This proves to be equivalent to assuming antennas of 
high directivity. 

Since any antenna may be replaced, as far as its distant effects are concerned, 
by a plane distribution of field, restriction to plane apertures is not in principle 
destructive of generality. But some antennas (particularly end-fire arrays such as 
the Yagi antenna) are so nonplanar that they are normally considered by other 
methods. 

Two-dimensional apertures are readily handled as a generalization of the one¬ 
dimensional case. 

Let the aperture distribution of electric field at the point x at time t be 
F(x ) cos [a>t — <f){x)], where co is the angular frequency of the (monochromatic) 



Fig. 15.1 An antenna which can be regarded as a plane aperture. 
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oscillation and F(x) and <£(x) are the amplitude and phase, respectively. The pha- 
sor E(x), that is, the complex quantity given by 

E(x) = F(x>T^ x) , 

will be understood wherever electric fields are dealt with below. We note that the 
instantaneous field is given by the real part of E(x) exp i(ot; that is, 

F(x) cos [cot — <£(x)] = Re [E(x)e^‘\. 

By Huyghens' principle, the electric field produced at a distant point will be 
the sum of the effects of the elements of the aperture. Each element produces an 
effect proportional in amplitude to the field at the element and retarded in phase 
by the number of cycles contained in the path to the distant point. Thus at a dis¬ 
tance r the field due to the element between x and x 4- dx is proportional to 

E(x) dxe~‘ 2vr/K , 

where A is the wavelength. 

Consider the field at a distant point P in a direction making an angle 0 with 
the z axis (Fig. 15.2). Let the point P be at a distance R from the origin x = 0, z = 0. 
Then to an approximation, 

r = R + x sin 0 
= R + xs 

where s = sin 0. 

Then E(x)e avr ^dx 

becomes E(x)e~ i2nR ^e~ i2nx ^ > ' dx. 

Let the factor exp (—HttR/A), which expresses the average phase retardation of 
the effects of the aperture elements at a distance R, be lumped with the complex 
constant of proportionality. Then, integrating all the separate effects, we find that 
the distant field, in the direction s, is given by 

f E(x]e~ i27rxs/X dx. 

J -oo 



Fig. 15.2 


Construction for applying Huyghens' principle. 
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The distant field, as a function of direction, is thus seen to be related to the 
aperture field distribution through the Fourier transformation. To throw the ba¬ 
sic relation into the standard form, we henceforth measure distances in the aper¬ 
ture plane in terms of the wavelength; that is, we deal in x/X instead of x. We then 
define E(x/ A) to be equal to the old E(x) and introduce P(s) such that 

p(s) - 

The quantity P(s), which is proportional to the distant field produced in the di¬ 
rection s, is known as the field radiation pattern or angular spectrum. Usually it 
is normalized in some way, but as we have introduced it, it depends not only on 
the character of the aperture excitation E(x) but also on the level of excitation. 
When normalized, it is characteristic of the antenna alone, irrespective of the 
strength of the energy source. 

By the reciprocal property of the Fourier transformation, it then follows that 

£ (f) = r p ( s ¥ 7Mx/A)s ‘ is - 

Since s is the sine of an angle, the meaning of an integral taken between infinite 
limits of s may be obscure. However, the restriction to high directivity ensures 
that the integrand falls to zero while s is still well within the range —1 to +1. The 
precise limits then do not matter, provided only that they are large enough. 

As an example consider an aperture for which 

£W-n(|), 

where x x 4 x/X) 

that is, a uniform field is maintained over a distance of w x wavelengths, outside 
which the field is zero. Then 


as shown in Fig. 15.3. 


P(s) = w k sine w K s 



Fig. 15.3 An aperture distribution and its angular spectrum. 
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In the one-dimensional theory that follows, we shall restrict the discussion to 
highly directive antennas. In the more general case the following phenomena en¬ 
ter the discussion. First, the polarization of the field must be taken into account; 
in directions around the normal to the aperture, the radiated energy is approxi¬ 
mately the same whether the aperture field is in the x or the y direction, but at 
wide angles a cosine factor enters in one case and not in the other. Another fac¬ 
tor allows for the difference which sets in between the radian and the unit of s. 
Then sharp edges in the aperture distribution must be allowed for; they set up 
evanescent fields which die away with increasing z and do not contribute to the 
radiated energy. In a highly directive antenna the energy of the evanescent fields 
is negligible in comparison with the radiation. 


ANALOGY WITH WAVEFORMS AND SPECTRA 


Having established a Fourier transform relation between a pair of physical quan¬ 
tities in the subject of antenna theory, we are in a position to translate statements 
about antennas into statements about waveforms and spectra, and vice versa. It 
only remains to set up a table of corresponding terms as follows: 


Waveforms and 
spectra 

Antennas 

Time t 

Aperture distance in wavelengths x A 

Frequency/ 

Direction sine s 

Waveform V(l) 

Aperture field distribution E(x A ) 

Spectrum S(/) 

Field radiation pattern or angular spectrum P(s) 


In view of the reciprocity of the Fourier transformation, it is possible to set 
up the correspondence in two different ways. The one given here is customary, 
as evidenced by terminology such as "angular spectrum." However, there are two 
separate and distinct antenna analogues to any one waveform-spectrum pair, and 
we draw on both as needed. 

It will be noticed that P(s) is the minus-?' transform of E(x A ), just as S(/) is the 
minus-? transform of V(t). Clearly this is a convenience in the present context, but 
the opposite choice might just as well have been made. For the present it is de¬ 
sirable to bear in mind that x and 6 are measured in opposite directions. 

If we know that a rectangular pulse has a spectrum which is a sine function 
of frequency, it follows that a uniformly excited finite aperture produces an an¬ 
gular spectrum of radiation which is a sine function of direction. 

Knowing that an impulse has a flat spectrum tells us that a very small aper¬ 
ture radiates isotropically, and the fact that an impulse pair has a cosinusoidal 
spectrum means that two infinitesimal antennas produce a cosinusoidal variation 
of field on a distant plane. These cases are illustrated in Fig. 15.4, and any of the 
Fourier transform pairs which have been encountered may be so interpreted. 
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Fig. 15.4 Some aperture distributions and the field that they produce on a distant 
plane. 


In addition to this possibility of reinterpreting particular transform pairs, there 
are other classes of information which may be transferred from our body of knowl¬ 
edge about waveforms and their spectra. For example, all the theorems given ear¬ 
lier may be endowed with new meaning in the new physical field. Furthermore, 
all the corresponding properties investigated previously may be translated into 
corresponding properties of aperture distributions and their angular spectra. As 
a first example, consider the similarity theorem. 


BEAM WIDTH AND APERTURE WIDTH 

The similarity theorem tells us that if the dimensions of an aperture are scaled 
up, the form of the aperture distribution being kept the same, then the field ra¬ 
diation pattern retains its form and is compressed by the scaling factor, for if 

E(x a ) gives rise to P(s), 

then E(ax A ) gives rise to |a| -1 

Thus the wider the aperture, the narrower the beam. 
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Fig. 15.5 Relations between some antenna quantities. 


The quantity |P(s)| 2 will be referred to as the angular power spectrum. Its 
Fourier transform is the autocorrelation function of the aperture distribution. From 
the reciprocal relation between the equivalent widths of a function and its trans¬ 
form it follows that, given an aperture distribution, we can calculate the effective 
beam width of its radiation by taking the reciprocal of the equivalent width of 
the autocorrelation function of the aperture distribution. For example, if we have 
a uniform aperture 10 wavelengths wide, the equivalent width of the (triangular) 
autocorrelation function will be 10 wavelengths; hence the equivalent width of 
the angular power spectrum will be one-tenth of a radian, or 5.7 degrees. This ex¬ 
ample is illustrated in Fig. 15.5. 


HI 

BEAM SWINGING 

According to the shift theorem, if a waveform is shifted with respect to t = 0, the 
result is a progressive phase delay increasing with increasing frequency f. One 
must therefore be able to shift the beam of an antenna (with respect to s = 0) by 
introducing a linear gradient of phase along the aperture coordinate x. In fact the 
shift theorem states that 

E(x,)e' a ^ D P(s + S). 

Hence, to shift the beam by an amount S it is necessary to introduce a phase gra¬ 
dient of S cycles per wavelength along the aperture. 

Various methods of beam swinging are in use which depend on this princi¬ 
ple. A direct approach is to insert phase shifters or to introduce extra lengths of 
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transmission line. Extra air paths may be introduced, as in the method of swing¬ 
ing the beam of a parabolic reflector by displacing the feed point from the focus. 
Small shifts in frequency can also be used to introduce a suitable phase gradient. 
If a thin dielectric prism were placed on the aperture, it would introduce a pro¬ 
gressive phase delay depending linearly on x, and the beam would consequently 
be shifted. The amount of shift would be precisely that which we would calcu¬ 
late on the basis of the prismatic refraction. 


H 

ARRAYS OF ARRAYS 


In its application to antennas, the convolution theorem parades as the array-of- 
arrays rule. According to this well-known rule, the field pattern of a set of iden¬ 
tical antennas is the product of the pattern of a single antenna and an "array fac¬ 
tor." This factor is the pattern which would be obtained if the set of antennas were 
replaced by a set of point sources. 

Let the aperture distribution of a certain antenna be E(x/A). Then the distrib¬ 
ution 



is a set of N such antennas centered at the points x = x lr x 2 ,..., x N . Such a dis¬ 
tribution may be expressed as a convolution 



where q(x/X) is a set of impulses. 

Let Q(s) be the Fourier transform of q(x/ A). It follows from the convolution theo¬ 
rem that if a single antenna has a pattern P(s), then the set of antennas has a pat¬ 
tern 


P(s)Q(s)- 

Here Q(s) is the array factor. 

We may also apply the convolution theorem in reverse. If we begin with an 
aperture distribution E(x/A) and then multiply it by some factor depending on x, 
then the effect on the beam may be deduced by convolving the original beam with 
the transform of the factor. For example, many aperture distributions are ap¬ 
proximately uniform, departing from uniformity only in that the excitation falls 
off toward the edges. This broad tapering factor has a narrow transform whose 
convolution with the pattern of the uniform distribution makes the necessary 
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modification. The multiplying factor need not be real; suppose that it is exp ikx, 
that is, a factor whose modulus is unity and whose phase is proportional to x. Its 
transform is a displaced impulse. Convolution with a displaced impulse simply 
displaces the beam. 


INTERFEROMETERS 

The modulation theorem, a special case of the convolution theorem, has particu¬ 
lar significance for antennas. Consider a pair of identical antennas spaced well 
apart. Such an arrangement is called a two-element interferometer. Since the full 
distribution can be expressed as a convolution between a single element and a 
pulse pair of the appropriate spacing, the pattern may be obtained from that of a 
single antenna simply by multiplying it by a suitable cosine function of s. 

Thus Fig. 15.6 shows an aperture distribution 

£ <**> = n (^) + n (^) 




Power radiation pattern n 



I _ U _ 


s 


Fig. 15.6 


An aperture distribution, representing a two-element interferometer, its 
angular spectrum P(s), and its power radiation pattern. 
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which could be set up by means of two antennas spaced 2W A connected to a cen¬ 
tral pair of terminals by equal lengths of cable. It follows that 

P(s) = 2 w x sine w x s cos 2rrW A s, 

and that the power radiation pattern is approximately the square of this, as shown 
in the figure. 


SPECTRAL SENSITIVITY FUNCTION 

When the first sky maps of radio emission were made it was apparent that the 
observed distribution of radio intensity as a function of direction could not be ex¬ 
actly the same as the true distribution because of averaging of the power received 
from different directions within the antenna beam. But because of the spherical 
curvature of the sky and the wide beams of 10° or more that were then at the limit 
of antenna practice, the connection with two-dimensional convolution was not 
immediately apparent. The notion that a celestial brightness distribution could be 
analyzed into spatially sinusoidal components and that the response of a scan¬ 
ning antenna would be sinusoidal was not obvious, and indeed is only an ap¬ 
proximation. However, when a small patch of sky is scanned by a narrow beam 
the situation is analogous to signal theory. The true distribution of brightness is 
the input signal; the power radiation pattern of the antenna is the impulse re¬ 
sponse of a linear system; and the output record is the convolution between the 
true distribution and the antenna pattern. Therefore, by the convolution theorem, 
there is a transfer function describing the sensitivity of the system to different 
spectral components. Spatially uniform sky brightness can now be spoken of as 
spatial d.c. The response to sinusoidal components of brightness weakens as the 
spatial frequency u, measured in cycles per radian, increases; the spatial minima, 
straddled by the beam, are partly filled in by contributions from brighter areas 
that are adjacent to the minima but still within the beam, while spatial maxima 
are eroded by inclusion within the beam of regions that are less bright. Conse¬ 
quently, the amplitude of a sinusoidal component, when scanned by an antenna, 
is reduced. As a function of spatial frequency u, the reduction factor, relative to 
spatial d.c., is the spectral sensitivity function. From the convolution theorem it 
follows that the autocorrelation function of the antenna aperture distribution (see 
Fig. 15.5) expresses the dependence of sensitivity on spatial frequency. For ex¬ 
ample, for an aperture distribution E(x/\) = Y\(x/w) as in Fig. 15.3, the spectral 
sensitivity function T(u) equals A(wu/X) r normalized to T(0) = 1. We learn from 
this that a simple antenna of width w responds to different spatial frequencies in 
a calculable way, that there is a critical spatial frequency s c = A /w above which 
the antenna does not respond at all, and that this cutoff is the same for all an¬ 
tennas representable by an aperture distribution of width w. 
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Thus the analogy with signal filters has a curious twist; a filter with impulse 
response of finite duration has a frequency response that runs on, while the anal¬ 
ogous frequency response of an antenna cuts off. The ability to translate antenna 
mapping terminology into terms of filter theory is discussed by Bracewell and 
Roberts (1954) and Bracewell (1958, 1962,1995). 


MODULATION TRANSFER FUNCTION 

An image created by a camera lens depends on the scene in a way that is related 
to antenna mapping as follows. First the three-dimensional scene is imagined to 
be projected onto an object plane parallel to the film plane in the camera. Then 
the light from each point of the object will be smeared into a spot of light on the 
film described as the point response function of the lens. Despite the effort of lens 
design, the point response function varies over the image plane, but is taken to 
be invariant for practical purposes over limited regions referred to as isoplanatic 
patches. Within such a patch a simple convolution relation holds between object 
and image. If the object brightness is a spatial sinusoid then the image will be si¬ 
nusoidal too, but of reduced amplitude as given by a visibility function that is 
normalized to be unity for spatial d.c. or uniform brightness. There may in gen¬ 
eral be a spatial phase shift although for the central isoplanatic patch the circular 
symmetry of a lens makes phase shift unimportant. 

The visibility function played a basic role in the measurement of stellar di¬ 
ameters by A. A. Michelson (1902) in observations made visually of the ampli¬ 
tude of sinusoidal diffraction fringes seen in a telescope when the aperture was 
blocked except for two parallel slits. By noting how the visibility of the fringes 
fell off with increased slit spacing. Michelson obtained part of the Fourier trans¬ 
form of the brightness distribution over Betelgeuse and deduced an angular size 
parameter. Atmospheric variation causes the diffraction fringes to be in motion 
in the eyepiece; consequently spatial phase was ignored. The descriptive term 
fringe visibility in optics came to be replaced by modulation transfer function 
(MTF); it corresponds to the absolute value of the spectral sensitivity function. 
When Fourier methods were introduced into lens design the modulation transfer 
function became an important tool for characterizing the performance of a lens 
in more detail than the customary resolution expressed in lines per cm, a single 
parameter easily obtainable by photographing ruled grids. 

When spatial phase came to be taken into account the term optical transfer func¬ 
tion (OTF) was adopted for the complex Fourier transform of the point response 
function; its absolute value is the old modulation transfer function. From the point 
of view of radio interferometry, fringe visibility generalizes into complex fringe vis¬ 
ibility, which takes into account not only the observed fringe amplitude but also 
any spatial displacement expressed in terms of the fringe spacing (Bracewell, 1958). 
In electronics, the complex factor T(/) (Chapter 9) relating the output sinusoid 
to the input sinusoid, as well as |T(/)|, may both be called the transfer function. 
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PHYSICAL ASPECTS OF THE ANGULAR SPECTRUM 

Fourier analysis of an aperture distribution E(x/A) is in terms of components of 
the form 

p( s y2^ 

Such a component is one whose amplitude is the same at all points x of the aper¬ 
ture but whose phase advances progressively along the aperture. It is the field 
that would be set up by a plane wave incident on the aperture from behind at a 
suitable angle to account for the phase gradient. (The angle of incidence is one 
whose sine is s.) Naturally the aperture field set up by a certain incident plane 
wave is the aperture field which will launch a plane wave in the same direction 
as the incident one. Thus each component of the aperture distribution launches a 
plane wave in a certain direction, and the total radiation from the aperture in all 
directions is expressible as a combination of infinite plane waves in all directions, 
each with suitable amplitude and phase. 

When |s| > 1, the phase 2ttx x s at the point x has a rate of change exceeding 
one full cycle in a distance A. It is apparent that no incident traveling wave can 
set up such a field because the crest-to-crest distance measured along any oblique 
section of the wave can exceed or equal the wavelength A, but cannot be less. If 
such an aperture field is imposed, no traveling wave will be launched; the field 
will simply die away in the z direction. 

Instead of analyzing into exponentials, we can break the aperture distribu¬ 
tion down into cosine and sine distributions of the form 

c ™{2irx k s). 

The spatial period of such a component, measured in units of x, is A/s, or the 
"spatial frequency" is s/A cycles per unit of x. Since each such component is 
composed of a pair of exponentials, it launches a pair of equal plane waves in di¬ 
rections equally inclined to the x direction. The lower the spatial frequency, the 
closer these two waves are to the z direction, and conversely, as the spatial fre¬ 
quency approaches one cycle per freespace wavelength A, we have the standing 
wave set up by two waves traveling in opposite directions in the plane of the 
aperture. 

This often-helpful approach to the angular distribution of the radiation from 
an aperture is an alternative to the treatment by Huyghens' principle, where the 
aperture is analyzed into elements. 


TWO-DIMENSIONAL THEORY 

Since the radiation from an aperture distribution essentially involves two- 
dimensional transform theory, the one-dimensional presentation should be re- 
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garded as an introduction to the subject. The following discussion sets up the 
Fourier transform relation in the two-dimensional case and without the restric¬ 
tion referred to above as the high-directivity approximation. 

Let the distribution of electric field over an aperture plane (x,y) have a com¬ 
ponent E y (x A ,y A ) in the y direction, and let the x component be zero. If it is not, it 
may be handled separately in the same way as the y component. There will be a 
z component normal to the aperture plane, but since it can be deduced from the 
y component by applying the condition that the divergence of the electric field 
vector should be zero, it is not needed in a specification of the aperture distribu¬ 
tion. 

The field set up by the aperture can be expressed as a sum of plane waves of 
the form 

g>^ m yi^mix + my +n z) dl dnit 

where l,m,n are direction cosines and ?P(l,m) dl dm is the complex amplitude of the 
waves in the cone l to / + dl, m to m 4- dm. 

A wave traveling in the direction ( l,m,n ) produces on the z = 0 plane a field 

9 ) (I,my WA)(b+m >' ) 

whose spatial period A' is given by 


(l 2 + m 2 f 

If l 2 + m 2 exceeds unity, the spatial period A' is less than A and thus repre¬ 
sents fine detail in the aperture distribution. In this case n is imaginary, because 
of the property of direction cosines that 

l 2 + m 2 + n 2 = 1, 

and a component plane wave takes the form 

e -{i*imv&(l tTn -yp"IW* +my) dl dnif 

which represents a wave traveling in the (x,y)-plane, but decaying exponentially 
with z. Such a field does not contribute to the radiation field at any great distance 
from the aperture. 

If f + m 2 is less than unity. A' ranges from infinity (propagation normal to 
aperture plane) to A (propagation parallel to plane). The power radiated per unit 
solid angle in the direction (Z,m) is proportional to the squared modulus of the 
complex amplitude of the waves proceeding, per unit solid angle, in a small cone 
of directions centered on (J,m). Since the solid angle subtended by an element 
dl dm is n 1 dl dm, the radiation pattern is 

3 c ‘(Z,m) dl dm 2 
n _1 dl dm 


= n 2 \®(l,m)\ 2 . 
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To find the aperture distribution E y (x x ,y x ) associated with a given we 

sum the component plane waves onz = 0 for all / and m. The cosine of the an¬ 
gle p between the field of the ray (l,m) and the y axis is n(l — P)~K Hence, re¬ 
solving the field of each ray into the y direction we have 

(1 ” p . W!,>nY 1 ' mx * ”” <*»• 

This is not quite the classical Fourier transformation. Let the Fourier trans¬ 
form of E y {x x ,y x ) be P(/,m); it will be referred to as the angular spectrum produced 
by the aperture distribution. Thus 

P(l,tn) = f°° f°° E y (x x ,y x )e~^ kWx+m ^ dx x dy x , 

J — oo J —o o 

and conversely, 

E v (x x/ y x ) = j°° w ^P(l,my 2 ” /mx+ ^dldm. 


It follows that the relation between P(l,m ) and the complex amplitude SP(/,m) 
is 


(1 ' l 2 f 


= P(lm). 


Here the radiation pattern is given by 


n 2 \<3>(l,m)\ 2 = (1 - f)\P(l,m)\ 2 
= cos 2 <f>\P(l,m)\ 2 , 


where 4> is the angle between the direction ( l,m ) and the yz plane. In the case of 
highly directional antennas radiating in directions close to the z direction, cos <j> 
is approximately equal to unity, and |P| 2 is essentially the same as the radiation 
pattern. 


OPTICAL DIFFRACTION 

Since the electromagnetic theory governing optical radiation is the same as for 
antennas, there is a fundamental analogy between optics and antenna theory. In¬ 
deed there is no clear boundary between radio waves and optics, as witnessed by 
the field of microwave optics. However, most optical devices are very much 
smaller than antennas, which leads to conspicuous differences in fabrication and 
use, even if there is a certain range of overlap. With the passage of time optical 
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excitation by optical fibers, or by microcircuits that are recognizably derived from 
microwave circuitry, have blurred the distinction between antennas and optics in 
practice, and it has become common to combine the fundamentals of both for 
some teaching purposes. 

Quantum effects are not significant for antennas except at the very highest 
frequencies or at very low temperatures. A more striking difference between a 
telescope and a receiving antenna is that the telescope captures an image in its 
focal plane while an antenna usually does not. There is indeed an image in the 
focal plane of a paraboloidal reflector, but only one pixel is normally captured, 
for example by a single electromagnetic horn centered on the focal point. It is as 
though the film or CCD array in the focal plane of a telescope was replaced by a 
single photodetector. So when point response function is mentioned, in optics that 
is an entity that is recorded in its entirety by an exposure on a photographic plate 
or film, whereas for an antenna a two-dimensional raster scan has to be performed. 
A closer analogy between an antenna and a telescope is provided in the practice 
of precision photometry of stars, where telescopes are in use that are provided 
with a single photodetector in the focal plane. 


FRESNEL DIFFRACTION 

In the discussion of antennas the objective was to relate a plane aperture distri¬ 
bution of field to the radiation pattern as a function of direction in the distant 
field. Appropriately for this book the development was based on the Fourier trans¬ 
form of the aperture distribution, or angular spectrum. Because of the uniqueness 
relationship between a function and its Fourier transform, the angular spectrum 
contains all the information that is contained in the specification of the aperture 
distribution, and thus provides a rigorous basis. However, with antennas, the dis¬ 
tant radiation pattern is of more importance to communication links and received 
the emphasis. 

Where does the distant field set in? If the aperture is N wavelengths across, 
the distant field, far field, or Fraunhofer region, sets in at a distance of N aper¬ 
ture widths. Communication ordinarily takes place over distances much greater 
than this. There are exceptional cases at very low frequencies, for example with 
radars studying the ionosphere, where the near field extends to several tens of 
kilometers; also, the elements of many antenna arrays are close enough together 
to be in each other's near fields, which becomes a factor in the antenna design. 
In optics on the other hand the near field, or Fresnel field, is of everyday impor¬ 
tance. Conveniently, the Fresnel field may also be discussed by considering the 
Fourier components of the aperture distribution. 

As before, let the aperture plane, or function domain, be the (x,y)-plane, while 
the z-axis is normal to the aperture plane. A Fourier component of the aperture 
distribution is a spatially stationary sinusoid such as cos k x x, where k x is the an¬ 
gular spatial frequency in radians per unit of x (radians per meter for example). 
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The crest lines of this particular wave are parallel to the y-axis, while the z-axis 
passes through a crest line. The general component is of the form 

a cos (k x x + k y y) + b sin (k x x + k y y), 

which allows for any orientation on the (x,y)-plane and any position of the z-axis 
with respect to a crest line. But, by rotating and shifting the (x,y)-axes we can re¬ 
turn to cos kyX with whatever amplitude we please, and this expression will suf¬ 
fice for the following discussion. 

As we have seen, such a standing wave may be created by shining onto the 
(x,y)-plane, two equal plane waves of wavelength A described by rays equally in¬ 
clined at angle i to the z-axis and coplanar with it. It follows that the standing 
wave cos k x x, however created, will radiate a pair of equally inclined rays. The 
angle of incidence will be related to k x by sin i — fc x A/27r. An alternative parame¬ 
ter \ x/ the wavelength in the x-direction, is related to k x by k x = 2ir/k x . When the 
two traveling waves are added together at z = 0 the result is the standing wave 
cos k x x, or cos( 27 tx/Aj.). But away from the (x,y)-plane, where z > 0, the constituent 
traveling waves will combine, with delayed phase, to produce a reduced copy 
given by cos k x x cos k z z, where k$ + k% = (27r/A) 2 . At a distance z = 2ir/k z — A z from 
the aperture plane, the field will have returned to cos k^c. The field thus propa¬ 
gates in the z-direction through a distance A z in one cycle. Since A z must be greater 
than A (provided i £ 0), the speed in the z-direction is A z /A times the speed of the 
incident waves. This is exactly the situation in a waveguide that extends in the 
z-direction and is enclosed by conducting walls at x = ± A x /4. 

To understand this configuration better, consider two extreme cases. When 
i = 0, both incident waves coincide, A x is infinite, cos fc*x becomes unity inde¬ 
pendent of x, and there is uniform illumination over the aperture plane. Natu¬ 
rally this aperture distribution launches a single ray in the z-direction. If i is just 
a little less than v/2, and increasing, then the incident waves pass through each 
other in almost exactly opposite directions and produce a resultant wave in which 
A x ~ A, while A z —» oo. This might seem to exhaust the possible cases but it is per¬ 
fectly possible to create an aperture distribution where A x < A. This can be done 
by inserting an iris diaphragm in a waveguide or by oblique illumination as with 
total internal reflection inside glass. As z increases the field then decays expo¬ 
nentially, or evanesces, as cos k x x exp( - I k z I z). 

From this physical picture one can construct the Fresnel field at any distance 
z from a given aperture distribution as follows. Fourier analyze the aperture dis¬ 
tribution into sinusoids, of various spatial frequencies k x , multiply each by the 
corresponding propagation factor cos k z z, where k z = V(27t/A) z — k\ and recom¬ 
bine to synthesize the Fresnel field by addition. The presence of evanescent waves, 
which are not common in everyday applications, will be revealed by imaginary 
values of k z , for such components use the corresponding decay factor exp(— |fc z |). 

This procedure is rigorous and is similar to calculating the response of a fil¬ 
ter to an input waveform by analyzing into components, altering each separately 
by a transfer factor, and recombining. It is well adapted to numerical computa¬ 
tion of fields in the Fresnel region. 
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OTHER APPLICATIONS OF FOURIER ANALYSIS 

Antennas and optical devices are common parts of measuring instruments, com¬ 
munication links, recording equipment, machines, and elastic structures and as 
such play a role in a variety of fields. Microwave sensing of the environment and 
photography are examples where convolution relations exist between what is 
there and what is recorded. Thus a background in Fourier analysis is useful not 
only for understanding and designing radio and optical sensors themselves but 
also for their information-gathering functions. As far as the information aspect is 
concerned the sensor might be regarded as a black box specified by external prop¬ 
erties such as beamwidth. Not only is Fourier analysis a tool for electromagnetic 
design of the box contents but it is also a tool for the user who is not concerned 
with such details but is engaged in information gathering and processing. The no¬ 
tion that scanning or mapping with a beam in space is analogous to electrical fil¬ 
tering in time, once a novel and unformulated concept, illustrates the remarkable 
versatility of the Fourier approach. 

To further explore the field of antennas requires a sound background in elec¬ 
tromagnetic theory, followed by study of a text such as Kraus (1988), written by 
one of our outstanding teachers. Further detailed references can be found in other 
texts listed below and in the lists of references in articles in issues of the IEEE 
Transactions on Antennas and Propagation. To pursue the study of optical applica¬ 
tions refer to Goodman (1996), to the various publications of the Optical Society 
of America and SPIE (The International Society for Optical Engineering), and to 
other texts mentioned in the bibliography. 
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PROBLEMS 

1. Explain why the equivalent width of the angular spectrum P(s) might be unsatisfactory 
as a general-purpose beamwidth parameter. [> 

2. Draw diagrams on the complex plane of E(x) to illustrate the integral 

Take E(x/A) equal to unity over a certain range and zero beyond. Take values of s such 
that the path differences between extreme rays is 0, A/2, A, 3A/2. t> 

3. Explain with aid of a phasor diagram why the nulls in the pattern of a uniformly ex¬ 
cited aperture occur in directions such that the distant fields of the end elements of the 
aperture are in the same phase. 

4. Monopulse antenna. An aperture Ls uniformly excited in amplitude, but one half is in 
antiphase with the other. Draw phasor diagrams to show that the angular spectrum has 
a null in the direction normal to the aperture and that the maximum halfway out to the 
next null is 2/ 1 t of what it would be in the absence of the phase reversal. 

5. Investigate by phasor diagrams the location of the first nulls, and the strength and lo¬ 
cation of the principal maximum in the pattern of a uniform aperture of which one half 
is in quadrature with the other. C> 
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6. Tolerance to decay. An antenna is fed from an energy source at one end by a transmis¬ 
sion line which excites each element with the same amplitude and phase. Because of 
deterioration of dielectric components, the transmission line becomes lossy, which 
causes the amplitude of excitation to diminish with distance from the source end. In¬ 
vestigate the effects on (a) the direction in which the beam points, and (b) the nulls. t> 

7. Consider the aperture distributions 

cos" 7 TX n(r). 

What is the effective beam width in each case? t> 

8. By taking an aperture distribution /(x)IT(jc) such that the amplitude is greater at the 
edges than at the center, can the effective beam width be made narrower than in the 
uniform case f(x) - 1? 

9. Give physical interpretations of the following theorems and relations in terms of an¬ 
tennas: Rayleigh's theorem, definite-integral relation, uncertainty relation. 

10. Focal-plane image. A radio image of a celestial object that emits radio waves is formed 
on a surface containing the focus of a paraboloidal reflector; show that it suffices 
to sample the image at certain discrete intervals. The collector normally found at 
the focus of a paraboloid has a finite size; is this size connected with the sampling 
interval? C> 

11. It is desired to form an x-ray image of an extended celestial object suspected of emit¬ 
ting x-rays, but it is difficult to focus the rays because they are not much refracted or re¬ 
flected. How would you tackle this problem? t> 

12. Given an example of a highly directive antenna for which the power level of the near 
side lobes of the radiation pattern goes down as |0| -3 where the angle 6 is measured 
from the center of the beam. Explain why this law cannot persist out to 8 = tt/2, and 
work out the actual behavior for your example. 

13. Sidelobe level. The amplitude of excitation of a circular aperture of radius a is propor¬ 
tional to a 2 — r 2 . Show that the first side lobe is 26 decibels below the main beam. Men¬ 
tion some reasons that this figure might not be attainable in practice; investigate the 
magnitude of the perturbation to be expected from a feed-supporting tripod that ob¬ 
structs 5 percent of the aperture. 

14. Visual acuity. Calculate the beam width of the eye in milliradians, taking the diameter 
of the pupil to be 4 millimeters. 

15. Radiation from slot. The y component of tangential electric field in the aperture of a 
slot antenna is given by 

E, - m)cos(^) 

where the width w is small compared with the length l. What is the equivalent width 
of the beam in the principal directions? In what direction is the radiation zero? 
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16. Slot array. An array of eight parallel slots is cut in the metal undersurface of an aircraft. 
The width and length of the slots are fixed by structural considerations, and the slot 
spacing is to be chosen so that the gain is a maximum. The structural expert claims that 
the slots can be tightly packed because the field intensity on the ground vertically be¬ 
low the aircraft is independent of the spacing, by Huyghens' principle. The antenna ex¬ 
pert says the field intensity may be the same, but that extra power will be radiated in 
unwanted directions; he proposes to install them four-fifths of a wavelength apart. His 
assistant argues by Rayleigh's theorem that the power radiated is the sum of the pow¬ 
ers passing through each slot and concludes that tighter packing is warranted, pro¬ 
vided the beam width is unimportant. Identify and correct the wrong statements. t> 

17. Lunar occultation. A remote point source of meter-wave radiation emerges from be¬ 
hind the moon's limb. Show that the power received by an antenna varies as 

where D is the distance to the moon and x is the distance of the observer from the graz¬ 
ing ray. Let q(x) be the derivative of this expression with respect to x. Show that the 
Fourier transform of q(x) is given by 

Q(s) = ADc” rADs2sKns . 

Let the derivative of the power received from an extended source be g(x); show that it 
has the same autocorrelation function as the true source distribution. Since convolving 
a function with q(x) merely scrambles its Fourier components by dephasing them in 
proportion to the square of their frequency, convolution with q(-x ) should unscramble 
them. Examine the merits of 


q(-x) * g(x) 

as a restoration of the true source distribution. 


18. Wild's array. A well-known antenna consists of 96 steerable 42-foot paraboloids equally 
spaced on a circle 1.5 kilometers in radius, and operates at a wavelength of 3.5 meters. 
Show that the angular spectrum as a function of the direction cosines / and m is 



/ 2irp 2irp\11 

27 t x 430 N cos —— m sin J >P(r) 


where r — (l 2 + m 2 )* and P(r) is the angular spectrum of a single element. Note that the 
superposition of the 96 cosinusoidal corrugations equally spaced in orientation peaks 
up at the origin and on certain concentric rings at points where the crests and troughs 
of the corrugations tend to converge. Show directly that the central peak is to a close 
approximation described by / 0 (27r x 430r)P(r). Show that the precise result is 


[/o(27r X 430r) + 2/ % (2 t7 X 430r) cos 96 6 + 2/ 192 (2tt x 430r) cos 1926 + .. ,]P(r) 


where 6 = arctan ( m/l ). t> 


19. Ocean wave direction finder. Show how an array of pressure gauges could be con¬ 
structed on the sea bottom for directional reception of wave energy, and how by suit¬ 
able processing of the pressure record from each instrument, various directions could 
be examined. Why is it that the beam of an antenna array, on the contrary, points in only 
one direction at a time; and why does there not appear to be any problem analogous to 
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that of correctly phasing antenna elements? The ocean swell off the coast of California 
in the frequency range 50 to 100 cycles per kilosecond (wavelengths up to about 1 kilo¬ 
meter) comes principally from storms in the Southern Ocean. Could this be confirmed 
by a coastal array? C> 

20. Calculate the diffraction pattern of an aperture in the form of an equilateral triangle. 

21. High-resolution interferometer. Eighteen identical antennas are located at x = 
1,2,3,..., 15,16,16.5,32.5, where the unit of x is large compared with the wavelength. 
The signals from all the antennas are brought to a common point through identical 
transmission lines and there the voltages from the first 16 are added, those from the re¬ 
maining two (at x = 16.5 and 32.5) are added, and the two resulting voltages are mul¬ 
tiplied together. A point source of radiation passes through the beam of this system. 
Show that the width of the response is approximately equal to the half-power 
beamwidth of a single long antenna stretching from x = 1 to x = 48. t> 

22. Celestial raster scanning. The response of a radiometer to a celestial radiation source, 
under conditions often met in practice, is given by the two-dimensional convolution 
A ** T, where T is the temperature of the source as a function of direction and A is the 
response to a point source. A source is scanned in a raster pattern with a spacing of X 
miUiradians between successive scans. Show that the data so obtained suffice to fill in 
the missing scans, provided X < 500 A /w, where A is the wavelength and w is defined 
as follows. Make an orthogonal projection of the antenna aperture onto a plane per¬ 
pendicular to the direction of the source; then w is the width of the projected aperture 
in the direction perpendicular to a raster line. 

23. Spoke diffraction pattern. Consider a function f(x,y) which consists of a line impulse 
6(y) plus N - 1 copies rotated respectively 180° i/N where i = 1, 2,..., N - 1. Thus 
there are N line impulses in all (or 2 N "spokes"). Let f(x,y) = f(r,6). Write an expres¬ 
sion for /(r,0). Find F(q,6), the two-dimensional Fourier transform of f(x,y). 

24. Triangular aperture. An equilateral triangular aperture many wavelengths in extent 
lies in a plane and has a uniform excitation of unity. Outside the triangle the excitation 
is zero. The angular spectrum is P(l,m). Consider the contour P(l,m) = 0.707P(0,0) 
(i.e., the half-power contour), (a) Does it remind you of a circle, a triangle, or some 
other shape? ( b ) Can you explain simply (other than by blind calculation) how it 
comes to possess the character that you have discovered? ( c ) Can you give a reason 
for thinking that there does or does not exist a null contour of P(l,m) surrounding the 
main beam? t> 

25. Apodization. The aperture field distribution on a telescope of diameter 2 a is character¬ 
ized by E 0 ( r ) = Tl(r/2a) and, associated with the discontinuous reduction to zero at 
r = a, there are strong diffraction rings, or optical sidelobes, that do not die away very 
rapidly. In fact, since 

n(r/2«) has Hankel transform (2a) 2 jinc 2 aq, 

where jinc q = (2q)~ 1 Ji(irq), and if q l,/j(^)~(2 irq) ^ cos (q - 37t/ 4), the sidelobe 
amplitude dies away as q 3/2 and the power as q 3 . If we wish to make the sidelobes fall 
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to lower levels, we may remove the discontinuity and go even further, to remove the 
discontinuity in slope, and so on. Apertures treated by shading in this way are said to 
be apodized. For example, an aperture field distribution (1 - P/ a 2 )Yl(r/2a) is continu¬ 
ous but has discontinuous slope at r = a; (1 - P/a 2 ) 2 Yl(r/2a) has continuous slope but 
discontinuous second derivative, and so on. In general, we can say that the Jtth deriva¬ 
tive of (1 - Pfa 2 ) k Y[(r/2a) is discontinuous. As k increases, the aperture functions 
(1 — P/a 7 ) k n(r/2a) thus generated exhibit progressively improved sidelobe reduc¬ 
tion. They are called Sonine functions. Show that (1 — P/a 2 fTl{r/2a) has HT 
, ira l 2!‘ +l k\(2ircu})~ k ~ 7*+ i(2iraq). 

26. Nulling interferometry. A nearby star with an angular diameter of 0.001" is to be in¬ 
spected for the possible presence of a planet at an angular distance 0.5" by use of a two- 
element interferometer. The star's radiation is 5000 times greater than the planet's. The 
two interferometer elements will be connected together in antiphase so that a null in 
the directional response can be pointed at the star. How many wavelengths should sep¬ 
arate the interferometer elements in order that the presumed planet will lie in a direc¬ 
tion of maximum reception of the interferometer? t> 

27. Parabolic aperture distribution. An aperture distribution is given by E(f) = 
(1 — 4g 2 /a 2 )n(f/a), where £ = x/A and a = 10. (a) What is the overall width of the aper¬ 
ture in wavelengths? (fc) Find the angular spectrum P(s), normalized so that P(0) = 1. 
(c) Show that the first sidelobe occurs at s = 0.01835, or ±1.05°, from the beam axis 
and is 21 dB down relative to the main beam. I> 
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Fourier transform theory arises in statistics and in physical subjects involving 
random phenomena in several ways, many of them traceable to a certain convo¬ 
lution relation that plays a basic role. Application of the convolution theorem to 
this basic relation then introduces Fourier transforms and enables us to bring to 
bear the theory dealt with in this book. 

The range of topics involved is extremely wide, embracing all those branches 
of physics and engineering in which random phenomena are considered. Our ex¬ 
amples, however, can of necessity illustrate only a negligible fraction of the many 
possible applications. Suitable texts for related reading include Gardner (1986), 
Gray (1987), Leon-Garcia (1989), Papoulis (1965), and Parzen (1962). 

We begin with a resume of the terminology to be used. Examples of frequency 
distributions are the normal distribution (of errors), the Rayleigh distribution, the 
Poisson distribution, and other well-known functions describing the relative fre¬ 
quency with which some quantity assumes various possible values. In general we 
shall use the notation P(x) for a frequency distribution; then the relative frequency, 
or probability, with which some quantity assumes values between x and x + dx 
is P(x) dx, a dimensionless quantity. (In cases where dx has physical dimensions, 
P(x) also has dimensions, which are the reciprocal of those of dx.) 

Because of the variety of applications of statistical theory, we encounter many 
terms more or less synonymous with frequency distribution, such as probability 
distribution, probability law, probability density function, and distribution func¬ 
tion. 1 

In the following section two problems are worked out which exhibit the con¬ 
volution relation referred to above. 


1 The term "distribution function" is also used to denote cumulative frequency distribution, the inte¬ 
gral of P(x) from —oo. 
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DISTRIBUTION OF A SUM 


If we purchase a large number of 100-ohm resistors quoted as subject to a 10 per¬ 
cent tolerance, we shall find that the resistances range from 90 to 110 ohms, and 
that there are roughly as many in one 1-ohm interval as in any other. The varia¬ 
tions are compatible with those to be expected if the resistors were drawn from 
an infinite supply containing equal numbers of resistors in any 1-ohm interval be¬ 
tween 90 and 110 and none outside that range. This is a consequence of the method 
of manufacture and sorting by which the resistors are produced. (There is an in¬ 
sidious possibility that there will be no resistances between 99 and 101 ohms, 
those resistors having been sorted out and sold at a premium as precision resis¬ 
tors.) Let us suppose, therefore, that our stock of resistors has been drawn from 
a supply in which the frequency of occurrence of resistances between R and 
R + dR is Pj(jR) dR, where 


pm 


= To n { 


R - 100' 

20 , 


In this formula I1(R) is the unit rectangle function, and the factor ^ allows 
for the requirement that 




The frequency distribution P,(K) is shown in Fig. 16.1. 

If we also have a stock of 50-ohm resistors, also with a 10 percent tolerance, 
we have a second frequency distribution P 2 (R) given by 


pm 


i ^f R 
= w n {~ 



Fig. 16.1 Frequency distribution of a resistance R formed by a series combination 
of two stock resistors, each having a tolerance of 10 percent. 
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We propose to build an electronic circuit, in which the design calls for a 150-ohm 
resistance, by combining two of the stock resistors in series, and we require to 
know what tolerance should be ascribed to the composite element. In other words, 
we wish to know the distribution describing the frequency of occurrence of re¬ 
sistances lying between the minimum possible value of 135 ohms and the maxi¬ 
mum of 165. Call this frequency distribution P(R). 

It is seen that both P,(R) and P 2 (R) enter into the determination of P(R). The 
problem is solved as follows. Let the resistor picked from the 100-ohm stock have 
a resistance R'; then if the series combination is to have a total resistance R, the 
resistor from the 50-ohm stock will have to have resistance R - R\ The frequency 
of occurrence of a total resistance R will be the product of the frequencies of oc¬ 
currence of R' in the first component and R — R' in the second, integrated over 
the range of possibilities of R'; that is, 

P(R) = [°° P^R')P 2 {R - R')dR'. 

J -OO 

In this integral the limits of integration could be put at 90 and 110, since that is 
the range of possible values of R' in the particular circumstances under consid¬ 
eration. Since, however, P,(R) has been defined to be zero outside the range of 90 
to 110, the value of the integral is not affected by the use of infinite limits, and 
there is a gain in generality of the formula. 

Inspection of the result now reveals that Pi(R) and P 2 (R) enter into the con¬ 
stitution of P(R) through the standard convolution integral; in fact, in asterisk 
notation, 

P = P t * P 2 . 

This is an instance of the basic convolution relation between the frequency 
distribution describing the sum of two quantities and the frequency distributions 
of the given quantities. In this particular case the convolution can readily be 
performed, and it is found that the composite resistance has a mean value of 
150 ohms and is distributed trapezoidally as shown in Fig. 16.1. 

This trapezoidal response is, of course, what would result from scanning a 
uniform stripe 20 units wide on a sound track with a slit 10 units wide; as the slit 
moved onto the stripe, there would be a linear change in response, then an in¬ 
terval of unchanged response while the slit was entirely contained within the lim¬ 
its of the stripe, and then a linear return to the initial state. The duration of each 
of the three phases would be 10 units. A similar analogy exists with any other sit¬ 
uation involving convolution. For example, a rectangular pulse lasting 20 units 
of time, if put into a filter whose impulse response was a rectangular pulse last¬ 
ing 10 units of time, would produce the trapezoidal output illustrated. 

Among the properties of convolution is the additive property of the abscis¬ 
sas of the centroids, and it is seen that the mean value of the composite resistance 
is indeed the sum of the means of the components. Also, the area under the con¬ 
volution is the product of the areas under the convolved functions; since both 
Pj(R) and P 2 (R) had unit area to begin with, the same should be true of P(R), and 
inspection confirms that this is so. Variances are also additive under convolution; 
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from this it can be seen that the standard deviation of the composite resistance 
from its mean represents a smaller percentage than for the components. In this 
sense the tolerance has been improved but, of course, the spread between ex¬ 
tremes is still 10 percent. If, however, the original distributions had been more 
rounded, or if more elements were connected in series, then the tendency toward 
a Gaussian result in accordance with the central-limit theorem would be more ad¬ 
vanced, and the use of the standard deviation instead of the extreme range as a 
measure of spread would be quite appropriate. 

As a second example, consider a barrel full of money, half consisting of dol¬ 
lar bills, the rest being fives and tens and a few twenties. To be more precise, let 
the frequency of occurrence of n-dollar bills be proportional to the nth term in the 
sequence 

{10 000600003000000000 1}. 

Since the sum of the terms of the sequence is 20, it will be convenient to deal in¬ 
stead with a normalized sequence whose sum is unity: 

0 0 0 fo 0 0 0 0 I 0 0 0 0 0 0 0 0 0 

Let the nth term of the sequence be denoted by pi(n); it is the frequency of oc¬ 
currence of n-dollar bills in the barrel. 

If a single bill is drawn from the barrel, this sequence describes the relative 
frequencies with which bills of different denominations may be expected. Now if 
two bills are drawn, and the amounts added together, we may ask what will be 
the corresponding sequence describing the distribution of the total sum drawn. 
Let p(n) be the nth term of the wanted sequence. If the first draw is m dollars, 
then the second must be n — m if the total sum drawn is to be n dollars. By the 
product rule for the joint occurrence of independent events, Pi(m)pi(n — m,) is the 
frequency with which we may expect to draw just m dollars on the first draw and 
n — m on the second. Summing over all possible first choices m, we have 

P(») = ” m )- 

m 

Thus the wanted sequence is the serial product of the given sequence with itself, 
or, in asterisk notation, 

{p} = M * {M- 

Figure 16.2 shows the calculation being carried out numerically by writing 
the given sequence upward on a movable strip of paper. The strip is shown in 
position for calculating the value of opposite the arrow; this is the frequency 
with which we might expect to draw six dollars. The values in parentheses still 
remain to be calculated at this point. The full result is 

{OliOOOglOOOgjljOOOSOOOOil,! 

OOO^OOOOjaj ... 4 J 0 }. 

As a numerical check it may be verified that the sum of the terms is unity. 
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Fig. 16.2 Calculating the serial product of /?,(«) with itself. 


The very close similarity between this example and the earlier one dealing 
with resistors will be apparent. In one case a wanted frequency distribution de¬ 
pends on two given distributions through convolution, and in the other through 
a serial product. However, if in the resistor problem numerical computation were 
resorted to in a case where the given distributions consisted of data not amenable 
to integration by analytic methods, we would compute a serial product based on 
sufficiently close-spaced data. Thus the numerical approach to both problems is 
the same. 

Conversely, there is nothing gained by making a distinction between the two 
problems in algebraic treatment; in this case, however, we treat both in terms of 
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convolution. Thus the contents of the barrel may be described by a frequency dis¬ 
tribution over a continuous variable x by writing 

Pi(x) = - 1) + £ 0 8(x - 5) + itfx - 10) + £>S(x - 20). 

Figure 16.3 illustrates this by means of the convention that an impulse symbol is 
represented by an arrow of height equal to the strength of the impulse. The fig¬ 
ure also shows the distribution for the sum of two draws, namely P(x), which 
may be written 

P(x) = P x (x) * P x (x) 

= i5o[100S(x - 2) 4- 1205(x - 6) + 36S(x - 10) + 60S(x - 11) 

4- 368(* - 15) + 98(r - 20) + 20S(x - 21) 

4- 128(x - 25) + 68(x - 30) + S(x - 40)]. 

It may be verified that the integral of both Pj(x) and P(x) is unity. 

We have now seen the basic convolution relation, which may be restated 
briefly as follows. If two quantities can assume values of x describable by fre¬ 
quency distributions P t (x) and P 2 (x), respectively, then their sum is described by 
a frequency distribution P(x) given by 

P(x) = P x (x) * P 2 (x). 

We have assumed that neither of the two quantities is influenced by the choice of 
the other. But if the barrel of money had been filled by throwing in great wads of 
each denomination and the contents had not been thoroughly stirred, then the re¬ 
sults could be different; again, if there were only one twenty-dollar bill in the bar¬ 
rel, then drawing it would radically influence the second draw. Before the con¬ 
volution relation is applied, it is always necessary to consider whether the two 
draws are independent, or whether the product rule is applicable. 


10 



P(x) 



Fig. 16.3 Frequency distributions expressed in terms of impulse symbols. 



434 


The Fourier Transform and Its Applications 


CONSEQUENCES OF THE CONVOLUTION RELATION 

Let P(x) be the convolution of P a (x) and P 2 (x); that is, 

r oo 

P(x) = P,(x - w)P 2 (u) du, 

J -00 

and let m, m Xt and m 2 be the abscissas of the centroids of the three distributions 
P, P v and P 2 ; that is, 

Too 

1 xP(x ) dx 

J -OO 

m = — r -,- 

f oo 

P{x) dx 

J -OO 

Since it has been shown that the abscissas of the centroids are additive under con¬ 
volution, it follows that 

m = m x + m 2 . 

If P, P u and P 2 are frequency distributions, then m, m x , and m 2 are the mean val¬ 
ues for the three distributions. Therefore the theorem quoted above corresponds, 
in statistics, to the result that the mean of the sum of two random variables is the 
sum of the two respective means. 

According to a second theorem, variances are also additive under convolu¬ 
tion. Let 

f (x — m) 2 P(x) dx 

2 J “oo 

O’ =-7-;- 

f OO 

P(x) dx 

J -CO 

Then o 2 = a\ + cr\. 

The interpretation of this result in terms of statistics is well known. 

If three random quantities are added together, and their respective frequency 
distributions are Pi(x), P 2 (x), and P 3 (x), then the frequency distribution of the sum 
of the first two is P x * P 2 , and the frequency distribution of the sum of all three 
must be (JP X * P 2 ) * P 3 . But by the associative property of convolution it is not nec¬ 
essary to retain the parentheses, and therefore the distribution of the sum of the 
three quantities P(x) is given by 

P = Px * P 2 * P 3 . 

It also follows that 

m = m x + m 2 + m 3 
and <r 2 = erf + a\ + 03. 

This result clearly extends to the sum of any number of random quantities. 
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From the central-limit theorem we know that if several functions are con¬ 
volved together, the result approaches a Gaussian distribution, provided that 
certain conditions are fulfilled. Therefore it follows that if several random quan¬ 
tities are added, then the frequency distribution of the sum will approach a 
Gaussian distribution. The mean of the distribution will be the sum of the com¬ 
ponent means, and the variance will be the sum of the component variances. If 
sufficient quantities are involved to ensure that the Gaussian result is approached 
within an accuracy that is sufficient for some purpose, then the additive proper¬ 
ties of the mean and variance suffice to fix the parameters of the Gaussian dis¬ 
tribution. 

A final consequence of the convolution relation is that known properties of 
Fourier transforms may be brought to bear on statistics through the convolution 
theorem. This will now be considered. 


THE CHARACTERISTIC FUNCTION 

The characteristic function 0(f) associated with a frequency distribution P(x) is 
defined by the relation 

f 00 

< P(t ) = e“ x P(x) dx 

J —OO 

and is thus the plus-i Fourier transform of the frequency distribution. 

By transforming the relation 

P = Pj * P 2 

we find 0(f) = 0i(f)0 2 (f). 

In other words, by the convolution theorem, simple multiplication of the charac¬ 
teristic functions gives the characteristic function of the frequency distribution of 
a sum. 

Characteristic functions possess the following properties: 

f 00 

a. 0(0) = 1 [since P(ar) dx = 1]; 

J -00 

b. <f>(t) is hermitian [since P(x) is real]; that is, the real part of 0(f) is even, 
and the imaginary part odd; 

c. |0(f)| 1. 

In addition, the real and imaginary parts of the characteristic function may 
not be independent. If, for example, P(x) is zero for x < 0, the real and imaginary 
parts of 0(f) will form a Hilbert transform pair. If P(x) is zero over some other 
semi-infinite range then an appropriate application of the shift theorem will pro¬ 
duce a similar interconnection. 
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THE TRUNCATED EXPONENTIAL DISTRIBUTION 

As an illustration of the convolution relation, and to lay a basis for later consid¬ 
erations of noise waveforms, we consider the following frequency distribution: 

P(x) = X~ 1 e~ x/x H(x), 

where H(x) is the Heaviside unit step function (Fig. 16.4). This will be referred to 
as the truncated exponential distribution. The mean m and variance a 2 are given, 
respectively, by 

m = X 
a 2 = X 2 . 

This frequency distribution arises in a fundamental way. Consider a com¬ 
pletely random event, the best example of which is the spontaneous radioactive 
disintegration of an atomic nucleus. The occurrence of telephone calls, or the emis¬ 
sion of electrons from a cathode might furnish other examples under certain con¬ 
ditions. Figure 16.5 shows a record of such individual events. It has been shown 
by observation that an unstable atom is as likely to disintegrate at any one mo¬ 
ment as it is at any other moment; thus the number of disintegrations occurring 
per second in a radioactive mass is proportional, on the average, to the number 
of unstable atoms present. We shall assume that this number is so large that it is 
not noticeably depleted by the occurrence of the disintegrations. 

Examination of Fig. 16.5 shows that the interval between one event and the 
next has a certain average value corresponding to the average rate of occurrence, 
but also shows that intervals shorter than average are more frequent than longer 
ones. In fact, the shorter the interval, the more frequent, right down to zero in¬ 
terval. This fact is connected with a folk saying that misfortunes occur in pairs. 

We now show that the frequency of occurrence of an interval between x and 
x + dx is P(x) dx, where 

P(x) = X-'e~ x/x H(x), 

and X is the mean interval between events. 



Fig. 16.4 The truncated exponential distribution with mean X. 
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Fig. 16.5 A record of events occurring at random but at a constant average rate. 
The average interval is AB. 


Because the average interval between events is X, the average rate of occur¬ 
rence is X -1 per unit of x. Therefore the frequency of occurrence in a brief space 
Ax will be X -1 Ax; and the frequency of nonoccurrence will be 1 — X” 1 Ax. Sup¬ 
pose that, following one event, an interval x elapses before the occurrence of the 
next. Let x be N times Ax. The frequency with which the random event will fail 
to occur in each of N successive spaces Ax, to be followed by an occurrence in the 
succeeding space Ax, is by definition approximately P(x) Ax, and it is given by 

P(x) Ax = (1 - X 1 Ax) n X 1 Ax x > 0. 

In the limit as Ax —► 0, 

P(x) = Urn (1 - X" 1 Ax)* / a * X 1 
= X~ l e~ x/X x > 0. 

The frequency of an event with respect to its predecessor declines exponentially 
with delay (which cannot be negative). Hence 

P(x ) = X-'e~ x ' x H(x). 

The truncated exponential distribution arises wherever events occur ab¬ 
solutely randomly in time or in one-dimensional space, and then it describes the 
frequency distribution of the interval between one event and the next. 

It also arises commonly in another connection. The events shown in Fig. 16.5 
were identical events, but it often happens that events not only occur at random 
but have various sizes. Size distributions resembling the exponential are common, 
for example, among geophysical phenomena where small earthquakes, small 
showers of rain, and the like tend to be frequent and the larger events rare. Such 
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size distributions often occur because the phenomena are triggered at random and 
then release a quantity of something (such as elastic energy, or water) that has 
been accumulating steadily since the preceding event. If the size of the event is 
proportional to the elapsed interval, and the event is as likely to occur at one mo¬ 
ment as at any other, then the frequency distribution of sizes will follow the trun¬ 
cated exponential law exactly. 

Other quite distinct ways exist that give rise to the same distribution. One im¬ 
portant case comes up later in connection with the detection of noise waveforms. 


THE POISSON DISTRIBUTION 

This discussion takes as its point of departure the truncated exponential distrib¬ 
ution, denoted by E(x), where 

E(x) = e x H{x). 

By applying the convolution relation to describe the frequency distribution of 
a sum of quantities taken successively from distributions E(x), we obtain an un¬ 
derstanding of the Poisson distribution. This is important in itself, but in addi¬ 
tion it furnishes excellent examples of standard procedures with frequency dis¬ 
tributions. In particular, we gain a detailed view of a transition into a Gaussian 
distribution as envisaged by the central-limit theorem. 

To lend an air of reality to the development, we shall express it in terms of a 
physical situation. Thus let us assume that in a certain locality the frequency 
P(x) dx with which one day's rain is between x and x 4 - dx, is given by 

m = £(*)• 

The average daily rainfall is thus one unit. 

How much rain falls on two days? Since it is the sum of two quantities drawn 
from a known frequency distribution, use of the convolution relation is indicated. 
First, it is necessary to verify that the rainfall on any day is independent of that 
on the previous day. In many localities this is not so, each day tending to be like 
the previous day; but we are going to deal here with an unpredictable climate. 
Then the frequency distribution of two-day totals is 

P * P. 

Performing the indicated convolution, we find 
P * P = E(x) * E(x) 
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The frequency distribution E * Eof two-day totals is thus like the impulse re¬ 
sponse of a critically damped instrument (see Fig. 16.6 for E and E * E). This is 
different from the truncated exponential in that the most frequent two-day total 
is no longer zero; in fact there is a marked alteration in character in the direction 
of a normal or Gaussian distribution. The mean two-day total is two units; the 
mode is at one unit. 

The distribution of M-day totals is the w-fold self-convolution of E(x), 

[£(*)]*". 

We can easily evaluate this distribution for n = 3 by using the result for n = 2, 
obtaining 

[EM]* 5 = 




Fig. 16.6 The Pearson Type in distribution exhibited as successive self-convolutions 

of the truncated exponential E(x). 
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Fig. 16.7 E* n normalized to {x) = 1 to show the approach to Gaussian form. 


Thus if the conjecture is correct for n-day totals, it is also correct for (n + l)-day 
totals, and so on. But it is known to be correct for n = 3; hence it is correct for 
n = 4, and so on ad infinitum. 

The distribution 

~E(x) = [£(*)]*"' 

shown in Fig. 16.6 may be referred to as a Pearson Type HI distribution. It repre¬ 
sents the frequency with which the sum of n + 1 exponentially distributed quan¬ 
tities with unit mean value has a value x. 
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By the central-limit theorem we know that for large values of n we shall have 
approximately Gaussian distributions. 

The mean value of x is equal to n + 1, and the variance is equal to n + 1, as 
a consequence of the theorems that variance and the abscissa of the center of grav¬ 
ity are additive under convolution. (The mode can be shown to fall at x — n by 
differentiation.) 

' 1 

For large n, the standard deviation about the mean is n 1 times the mean. Thus 

if we express the distribution in terms of £ = xjn, so as to refer all the distribu¬ 
tions to the same mean, we have 


(n ~ 1)! 


E(x) = 


(« - 1 )! 




We expect this formula to exhibit the contraction to an ever-narrower Gaussian 
form, as in Fig. 16.7; that is, we expect that 


n 


n -1 


(n - 1)! 




. - A-e-fntf-iy 

(2 mif 


Putting e = £ — 1, and making use of the Stirling formula for factorials of large 
numbers 


n\ = (27rn)^n"e ", 



Fig. 16.8 The Poisson distribution regarded as a continuous set of histograms. 
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the left-hand side reduces to 


—(1 + e )"-i e -«a + «) = - -L_(i + ef-'e'™, 

(2 irrif 

which, for small values of e, expands to 


1 

{iTTtlf 


[1 - e - |(n - 2)c 2 + 



and thus matches, as far as these first terms go, a Gaussian distribution centered 
on £ = 1 — 1/n. 

If events occur at random as in Fig. 16.5 with an average interval of unity, the 
probability that precisely n events will occur in the interval x depends first on 
[£(*')]*" dx' (the probability that the nth event from now will occur in the inter¬ 
val x' ± \dx’, x' < x) and then on the probability that the one following those 
will occur after a further interval x - x'. This second probability is the integral of 
E(x) from x — x' to infinity and is thus equal to E(x — x'). Multiplying these two 
probabilities and integrating over the range of possibilities of x ', we have 


} 0 E(* - = [EM]* 1 "” = ^7EM- 


This is precisely the function we have been studying as a probability density per 
unit of x; as a discrete probability depending on n, however, we know it as the 
Poisson distribution (Fig. 16.8). 
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PROBLEMS 

1. Sum of reciprocals. The distribution of resistance in a batch of nominally identical re¬ 
sistors is P(x). Calculate the distribution of resistance of parallel combinations of two 
resistors from the batch. 
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2. Show that the frequency distribution of the complex impedance Z = X + iY obtained 
by connecting in series a resistance R and inductance L, each equally likely to be any¬ 
where within one percent of the nominal value, is given by 

p(x,y> = [ 5on (^—)«(Y)/ r] .. [5on(^)s ( x)M , 

where the double asterisk represents two-dimensional convolution, and sketch this dis¬ 
tribution on the complex plane of Z. 

3. Beating the odds. It is proposed to set up an absolute standard 1-megohm resistor of 
unusual precision, for delicate measurements on insulators, by taking 10,000 ordinary 
1 percent 100-ohm resistors and connecting them in series by means of mercury cups 
of negligible resistance. The argument given is as follows. If n resistors from a batch of 
mean resistance R and variance rr 2 are connected in series, the combined resistance will 
be, on the average over many trials, nR, and the variance will be no 2 . The standard de¬ 
viation about the mean will be rficr. Consequently, if a/R was originally of the order of 
10 -2 , it will be of the order of 

= (10,000)'* ^ = 10-2 x 10_2 = 10 -4 
nR R R 

for 10,000 resistors in series. Explain the fallacy in thinking that a resistance equal to 
1 megohm within one part in 10 4 could be achieved in this way. O 

4. Bernoulli distribution. The probability of emission of n electrons in 1 microsecond 
from a microscopic area of a cathode is 

0.96(n) + 0.18(n - 1). 

Calculate the probability of emission of n electrons in one second from a cathode that 
is more extensive by a large factor M. 

5. Poisson distribution. If a random event occurs 0.1 times per microsecond on the aver¬ 
age, what is the frequency of occurrence of just two events in 1 microsecond? 

6. Distribution of a sum. Calculate the frequency distributions of the totals thrown with 
(a) a pair of dice, (b) three dice. 

7. Distribution of a sum. A flip-flop circuit has two stable states, A and B. It changes from 
one state to the other whenever it is pulsed. If the pulses arrive at an average rate of 10 
per second, but at completely random times (as in Fig. 16.5), calculate the frequency 
distribution for the time interval between successive transitions from state A to state B. 
What is the most frequent value? 

8. Characteristic function. Show that if <p(t) is a characteristic function, then it must be ex¬ 
pressible as the autocorrelation function of some other function. Show that 2t cosech irt 
can be a characteristic function, and determine two or more functions of which it is the 
autocorrelation function. D> 

9. Spatial probability. A target whose location is better known in latitude than in longi¬ 
tude is fired upon by a weapon which is more accurate in azimuth than in range. 
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Calculate the two-dimensional probability distribution of the miss distance. Is it more 
favorable (for the one firing) to fire from the north or from the east? 

10. Moments. It is known that the mean and variance are additive under conditions where 
the probability distribution of a sum is given by a convolution relation. Is this true of 
the third moment? > 


11. Meteor-trail communication. A point-to-point communication system utilizes signal 
bursts due to specular reflection from the transient ionized trails left by meteors. If the 
transmitter is left on, the signal amplitude at the receiver consists of bursts of the form 
A = A^~ {, ~ QI, H{t - f,) occurring at random epochs The number of bursts with am¬ 
plitude greater than Ai is given by N = cA x “ during a certain period when c and a are 
constant. If communication is possible when the signal exceeds the threshold A Xr show 
that the channel is open for a time T given by 

T = -cAj“ 
a 

and that the fraction of usable bursts with durations exceeding t l is e~ at '/ T . 

12 . A Bernoulli trial is one whose outcome x is described by the probability distribution 
q S(x) + p f>(* — 1), where q = 1 — p. In terms of discrete probabilities this may be writ¬ 
ten {q p}. The sum of the outcomes after n independent trials has a distribution {q p}*", 

called the binomial distribution [because its terms P* are the same as in the ex¬ 

pansion of the nth power of the binomial expression q + p]. Show that the characteris¬ 
tic function of the binomial distribution is [q + p exp if]" and deduce that if two inde¬ 
pendent quantities have binomial distributions then their sum has a binomial distribu¬ 
tion provided that p is the same for each. 

13. Show that the characteristic function of the Poisson distribution (x"/n'.)e~ x is 
exp {x[exp it - 1]} and deduce that if two independent quantities have Poisson distri¬ 
butions with means x x and x 2 , then their sum has a Poisson distribution with mean 
x x + x 2 .l> 

14. Verify that the terms of the Poisson distribution [x n /n\) exp (— x), when summed for 
« = 0,1,2 ..., add up to unity. Show that, when x is a positive integer, there are always 
two equal terms. 

15. Probability distribution of sum. The chances of hitching a ride from the campus to the 
freeway on Sunday night are such that the probability is P,(t) dt that it will take a time 
between t and f + dt to get a lift, counting from the time the thumb is extended. Reports 
indicate that P x {t) is approximated by P x {t ) = 0.025 exp (-f/40), where t is in minutes. 
The travel time to the freeway averages 10 minutes but itself varies over a narrow range 
with a standard deviation of 2 minutes. Waiting time at the freeway is described by 
P 3 (f) = 0.1 exp (—f/10) and the travel time to the airport is 25 minutes ± 5 (standard de¬ 
viation). What is the mean travel time from the campus to the airport by this mode of 
transportation and what is the standard deviation? 
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16. Distribution of reciprocal. The frequency of occurrence of resistances between R and 
R + dR is 0.05n(0.05R — 5), but when they are tested on an instrument which mea¬ 
sures conductance it is found that the distribution does not appear to be flat-topped. 
What is the probable explanation? t> 

17. Bernoulli's theorem, central limit theorem. The impulse pair p6(x) + q8(x — X), 
where p and q are both positive and p + q = 1, may be convolved with itself several 
times to produce a string of impulses [pS(r) + q8(x - X)]*" whose strengths, as n -> oo, 
delineate a certain Gaussian function. Show that the multiple self-convolution with n 
factors approaches 

(2 ■nnpq'fe-^^^ III(jc/X). 

18. Central limit theorem, Bernoulli's theorem. The quantities p and q in Bernoulli's the¬ 
orem are necessarily positive because they represent probabilities. But if p and q were 
of opposite sign, what could be said about the n-fold self-convolution of 
p8{x) + q8(x - X)? 




Random Waveforms and Noise 


The whole of physics is permeated by naturally occurring random phenomena, 
and we may draw some examples from an account of a straightforward physical 
observation. Figure 17.1 shows a record obtained by allowing the extragalactic ra¬ 
dio source Cygnus A to pass through the beam of a radiotelescope. Clearly this 
radio source consists of at least two parts, but it is important to know whether 
there is also a halo associated with the two obvious components. The existence 
of a third source, broader and weaker than the first two, cannot, however, be re¬ 
vealed by studying this record, because of the presence of unwanted wiggles in 
the record. 

This is a typical example of detection of a signal against a noise background. 
The sources of the fluctuations in this example are well understood; microwave 
radiation emitted thermally from the earth and from the walls of the antenna 
transmission line enters the receiver, and the receiver itself generates radiation; 
the background emission of the galaxy contributes a tiny amount, but the source 
under study itself contributes significantly even when it is out of the main beam 
of the antenna. All this unwanted radiation adds up, and the total is not constant. 
The fluctuations, as the illustration shows, are smaller than the wanted signal, al¬ 
though the total unwanted power is actually very much greater. Such fluctuations 
often reveal characteristic behavior that is quite independent of their precise phys¬ 
ical cause, and this chapter will be concerned with these universal phenomena. 
However, it should certainly be recorded here that actual observations also often 
reveal behavior that is inexplicable from the standpoint of prior theory and can 
only be interpreted after observational experience; these peculiar phenomena, 
which may become the dominant ones as tire more understandable fluctuations 
are gradually reduced by appropriate measures, are too diverse to be studied from 
the literature. 

In our example, the wanted radiation itself also reveals random aspects; in 
fact the signal that we are extracting from the noise background is itself random 
noise. It is almost completely randomly polarized, which means that the electric 
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Fig. 17.1 Record of power received from the extragalactic radio source Cygnus A 
passing through the beam of a radio telescope, the first instrument to 
generate a radio beam (52 arcseconds, one dimensional) a$ good as that 
of the human eye (Swarup, Thompson and Bracewell, 1963). 


field in the wavefront is about as likely to point in one direction as any other. Fur¬ 
thermore, the amplitude of the electric field of the signal fluctuates in a charac¬ 
teristic way as time elapses. The fluctuations of the horizontal and vertical com¬ 
ponents of the field are identical in character but almost completely different in 
detail. 

For reading related to this chapter see Gardner (1988), Goodman (1996), Pa- 
poulis (1968), and Ripley (1981). 


DISCRETE REPRESENTATION BY RANDOM DIGITS 

To study the characteristics of noise in the various forms discussed above, we first 
construct a particular noise waveform by a purely numerical procedure and be¬ 
come familiar with its properties. In this example we work with sequences 
of numbers which may be deemed to represent successive samples of a band- 
limited waveform; therefore we need not hesitate at any time to graph the se¬ 
quence and draw a smooth curve through the points. To draw such a curve we 
may interpolate in accordance with the rules given in connection with the sam¬ 
pling theorem in Chapter 10. 

Suppose that digits from 0 to 9 can be drawn from a supply, any one digit be¬ 
ing as likely to be drawn as any other. For instance, we could take the random 



448 


The Fourier Transform and Its Applications 


numbers distributed uniformly between 0 and 1 that are provided by a computer 
language, multiply by 10, and take the integer part. But for the sake of a concrete 
example, we shall use here the successive digits in the decimal representation of 
7 r. We know that 

t t = 3.14159265358979323846264338327950288419716939937510.... 

These first 32 digits are graphed in Fig. 17.2. It has been shown that in almost all 
decimals the various digits occur with uniform frequency; that is, each occurs in 
about one-tenth of the possible places; and in the case of tt this question has been 
the subject of investigation out to extreme numbers of decimals. Certainly in the 
finite run illustrated the number of occurrences is not the same for each digit 
(the histogram on the left gives the totals), but there is no way of proving that 
this finite sequence is incompatible with having been drawn from a uniform 
supply. 

Let y, be the value of the fth digit; that is, y x = 3, y 2 — 1, y 3 = 4,.... We may 
also refer to the sequence {y t } and write 

{yj = {314159...}. 

The quantity t may be regarded as time, and it may be supposed that digits are 
drawn at instants regularly spaced at one unit of time. The mean m of the first N 
digits is given by 

yi + j /2 + y 3 + ■ • • + y N 1 A 
m = - N - 

for instance, when N = 32, the mean is 4.84. If we are correct in thinking that the 
digits are drawn from a uniform supply, then we would wish, in another way of 




Fig. 17.2 A finite sequence of digits y t from the decimal representation of tt, their 
occurrence histogram a(y), and the probability p(y ) we choose to associ¬ 
ate with the infinite sequence. 
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expressing a consequence of this property, that the mean m would approach a 
limit fj, equal to 4.5 as the number of digits N increased indefinitely, that is, that 

ul = lim m — 4.5. 

N—>oc 


This expectation could be made the basis of a (partial) test of the assumption of 
uniformity. 

An alternative way of calculating the mean m is to count the number of nines 
and multiply by 9, multiply the number of eights by 8, and so on, and divide by 
N. Let a(y) be the number of times the value y occurs; a histogram standing on 
end at the left of the sequence of digits in Fig. 17.2 represents a(y), and it is tab¬ 
ulated below. So 

< 1) + 2a(2) + ... + 8«(8 ) + 9a(9) 1 ^ . 

” = - N -" N ,? 0 ya{y) ‘ 

Considering the situation as the number of terms N increases without limit, we 
have for the value /jl which m approaches, 

ix — lim m 

• XT 


= lim — 
N—yoo N 


X y«(y) 


y=0 


= 2 V lim 

y = 0 


<y) 

N ' 


There is no reason why we should not replace the limit of the sum by the sum of 
the separate limits. Now the quantity a(y)/N, which is here 

y 0123456789 

«(y) 0247343234 

a(y)/N 0 .06 .12 .22 .09 .12 .09 .06 .09 .12 

tabulated for our particular case, is the fractional number of times the value y oc¬ 
curs, and we believe that this is the same in the limit for till values of y from 0 to 
9, namely 0.1. Calling this the probability p(y) that a value y will occur, we write 


p(y) k lim 

rvj/ N-xx) 


a(y) 

N ' 


In Fig. 17.2 p(y) is represented as a histogram standing on end. Since 2^(y) = N, 
it is clear that p(y) possesses the property 2p(y) = 1 that is required of a proba¬ 
bility distribution. 

Finally, then, we can write 


9 

^ = XyKy); 


y=o 
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or, in other words, the quantity /a, the mean in the limit of an indefinitely long 
sequence of values y t , can be expressed, not only as the limit of m, the mean of N 
terms, but in a slightly more complicated way, as the first moment of the proba¬ 
bility p(y) governing the occurrence of each value y. 

Similarly, the variance of the sequence {y t } approaches a limit which is the 
second moment of p(y) about y = /la; that is, 

2(y. - m f = i> - rfpk/)- 

” f=l y=0 

These results, which are well known in other connections, are restated here to 
form a link with the terminology to be employed. 

Later, the sequence of random digits will be interpreted as a waveform, ei¬ 
ther by interpolation of smoothly varying intermediate values, or by imagining a 
regular sequence of impulses with strengths as given by the random digits. In the 
first case the spectrum will cut off at a frequency fixed by whatever the time in¬ 
terval between samples is taken to be, and in the second case the spectrum will 
run on to indefinitely high frequencies; but in each case the mean of the sequence 
is the same as the mean of the function. 


FILTERING A RANDOM INPUT: EFFECT ON AMPLITUDE DISTRIBUTION 

A random waveform generated from the sequence of random digits in either of 
the ways mentioned above may be passed through a filter, and the output may 
be examined to see what the effects have been. We think of a filter as a device 
that transmits different frequencies differently, and so one of the effects will be a 
change in the spectrum of the input waveform. But first we consider the proba¬ 
bility distribution of amplitude and reach a remarkable conclusion. Since this con¬ 
clusion is a basic consequence of summing random numbers, the discussion will 
be given without direct reference to filters, but what we are about to do is pass 
the random waveform through a filter whose response to an input {1 0 0 0 • • •} 
is the 10 -digit sequence { 1111111111 }. 

Let us operate on our sequence of digits {y,} to form a new sequence { 77 ,} ac¬ 
cording to the following rule: is the sum of the first 10 values of y„ t} 2 is the 
sum of the second to the eleventh inclusive, and so on; that is, 

Vt = yt + y t +i "*■ y f+2 + . • • + yt+ 9* 

This sequence of numbers is graphed in Fig. 17.3, as far as the finite amount of 
data used in the previous graph allows. It is clear that the numbers are concen¬ 
trated in the 30s, 40s, 50s, and 60s, and that there are no values falling outside 
this range. The histogram on the left shows the totals in each range. Just as in the 
case of the total occurrences of the 32 original digits, we believe that the fractional 
number of occurrences of each value y, where y ranges from 0 to 90, will narrow 
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Fig. 17.3 A sequence of digits into which correlation has been introduced be¬ 
tween successive values, with corresponding spectral modification. 


in on some limit as the length of the sequence increases. We call this limit for each 
y the probability p l0 (y) that a sum of ten digits shall make a total y. 

Since it was shown in Chapter 16 that the sum of two independent quanti¬ 
ties having given probability distributions is distributed according to the convo¬ 
lution of the given distributions, we can immediately deduce p 10 (y), provided that 
successive digits in the decimal representation of rr are independent. This raises 
a new and grave question. 

Digression on independence. We could have avoided this question by postu¬ 
lating a sequence {y,} with the desired properties, without disclosing the actual 
values. However, since we have chosen to illustrate the subject by an actual ex¬ 
ample, a digression on independence is necessary; it is also appropriate, since the 
applicability of simple theory to actual data is an important matter. 

It is quite possible that the digits may have equal relative frequencies of 
occurrence in the long run, yet at the same time each need not be indepen¬ 
dent of its predecessor. For example, the infinite decimal fraction 
3.01234567890123456789..., which repeats in the way suggested, exhibits uni¬ 
form frequency of occurrence of each digit, but successive digits are not inde¬ 
pendent. 

A casual look at Fig. 17.2 does not reveal any obvious connections between 
one digit and the next; indeed, it has been established that in almost all decimals 
there is no connection, but it will certainly be in order here to apply some quan¬ 
titative test such as the following. If y t+t is truly independent of y t , then it is as 
likely to be on the same side of 4.5 as it is to be on the opposite. Counting reveals 
that y, +1 crossed to the other side of 4.5 from y, 15 times and remained on the 
same side 16 times. This is satisfactory; a stronger test is to examine the length of 
the runs above and below 4.5. Thus the first four digits 3, 1, 4, 1 are below, the 
next two are above, then we have one above, two below, and so on. A little far¬ 
ther there is a run of length 5 that is identified in Fig. 17.2. The lengths of the 16 
runs are 4, 2,1, 2,1, 5, 3, 1, 1, 1, 1, 1, 3, 1, 2, 3. It is clear that the probability of a 
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Fig. 17.4 The probability of a run of length k. 


run of length 1 is the probability that a crossing that has just occurred will be im¬ 
mediately followed by a return, namely The probability of a run of length 2 is 
|, and in general the probability p k of a nm of length k is 2~ k . 

A graph of p k = 2~ k is shown in Fig. 17.4, with points representing the actual 
total numbers of runs of different lengths in the example. One cannot fail to be 
struck by the agreement between theory and fact; but if we wished to pause and 
examine the significance of the agreement, it would be necessary to establish first 
the probability with which a run of length k occurs just n times out of 16. As an 
exercise the student might carry out a similar analysis of the length of runs of 
even digits and runs of odd digits. 

As a more detailed check, construct a correlation diagram by plotting y t+1 
against y t as in Fig. 17.5. If this diagram revealed an elongation along the diago- 



v, 


Fig. 17.5 


Correlation diagram relating each digit y t+1 to its predecessor 
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nal through the first and thud quadrants, it would mean a tendency of high val¬ 
ues to be followed by high, and low values by low. This tendency could be eval¬ 
uated numerically by calculating the covariance, or product moment about the 
centroid, 2(y f+1 — — (y f )). If desired, the product-moment correlation co¬ 

efficient could then be derived by dividing by the maximum possible value, but 
this entails much numerical work. Usually some other measure of correlation 
meets the demands of speed better; for example, we divide the diagram into quad¬ 
rants meeting at the median point, and count the number of points in each quad¬ 
rant. The excess in the first and third over those in the second and fourth, divided 
by the maximum possible value of that excess (the total number of points), pro¬ 
vides an excellent correlation coefficient, which in the present case comes to 0.03. 
Here again we do not pause to look more closely into the significance of this re¬ 
sult, but go on to note additional requirements imposed by independence. 

Either of the correlation coefficients mentioned could have small values, while 
at the same time there could be some degree of dependence of y f+1 upon y t . Fig¬ 
ure 17.6 presents an artificial example. Therefore it should be noticed that corre¬ 
lation coefficients alone are not sufficient to guarantee independence. To demon¬ 
strate independence, it would be necessary to show that the correlation diagram 
occupied the square lattice with the expected degree of uniformity and, in addi¬ 
tion, that the sequence of tracing out the diagram was free from order. 

In these tests we have been concentrating on the possible dependence of one 
digit on its immediate predecessor; but since we propose to add together 10 con¬ 
secutive digits, we should also look for such connections as could be revealed by 
constructing the eight further correlation diagrams of y, +2 , y (+3 , etc., up to y l+9 , 
against y t . 
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Fig. 17.6 


A correlation diagram showing dependence of y t+1 on y„ which would 
not be revealed by correlation coefficients. 
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At this point the writer will take the responsibility for asserting that succes¬ 
sive digits are indeed independent. 

This is an important step in the discussion of actual data, and the experi¬ 
menter or observer must remember that it was taken, in case of later conflict, be¬ 
cause one can never be absolutely sure that there is no underlying dependence. 
In effect, we have postulated a certain stochastic model, and we have found, from 
the partial tests so far made, no reason to doubt that it is a suitable choice as a 
basis for discussing the data in hand. We have also indicated the directions in 
which the theory of such tests, if elaborated, would lead. The responsibility for 
the degree of testing rests on the experimenter, who generally notes the absence 
of phenomena which, experience indicates, are most likely to complicate the sit¬ 
uation. 

The convolution relation. If the successive digits are independent, then the 
convolution relation holds, and {pio(y)} is the tenfold serial product of (p(y)} with 
itself; that is. 

In (vU = f— Illiliil ± 1*10 
\Pio\y)j tio 10 10 10 10 10 10 10 10 10/ 

= 1(T 10 {1 10 54 212 679 ... (91 terms) ... 54 10 1}. 

The numerical values may be established directly by carrying out the successive 
convolutions. By the central-limit theorem we know that these values will be ac¬ 
curately given by a normal distribution with mean and variance each 10 times 
the mean 4.5 and variance 8.25, respectively, of the infinite sequence {y f }. Hence 
the probability of occurrence of a value y in the infinite sequence {tj,} is given ap¬ 
proximately by 

Pl0(t/) - ---, e -(y-45f/(2x82.5) 

(277 X 82.5$ 

Of course, this approximate expression assigns nonzero probabilities to val¬ 
ues of y that are less than 0 and greater them 90, whereas we know from the method 
of construction of {tj,} that such values are impossible. Therefore it would be pos¬ 
sible to reveal that p 10 (y) was not in fact normal by examining a long-enough se¬ 
quence. However, an extremely long sequence would be needed. Certainly the 
short sequence illustrated in Fig. 17.3 can be taken as indistinguishable from one 
derived from a strictly normal probability distribution. 

The considerations that we have discussed reveal an important phenomenon. 
Because of the central-limit theorem, a sequence described by a probability dis¬ 
tribution, when subjected to summing of successive terms, leads to a new se¬ 
quence whose probability distribution is more nearly normal. Now, when a wave¬ 
form is passed through a filter the output is a sum of successive input values, 
duly weighted, and so we may expect that normal probability distributions will 
be a common property of the amplitude of random signals emerging from filters. 

The numerical process presented above as a running sum over ten 
terms is equivalent to passage through a filter with impulse response 
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{1111111111}. What would be the result of passing the sequence {y,} 
through a filter with impulse response {g 0 g x g 2 ■ ■ ■}? As a concrete example, let 

{&} = {531 1 }. 


Then the probability distribution of values of the output sequence is 

{1 00001000010000100001000010000 

1000010000100001 } 
*{1 00100100100100100100100100 1 } 
*{ 1111111111 } 

*{1 11111111 l}x 10~ 4 . 

= 1(T 4 {1 2 3 5 7 10 14 18 23 29 ... (91 terms) ... 3 2 1}. 

In general, the probability distribution of the filter output is 


± p (*)Ui p ( *)].[!,(*) 

go \go/\ Lgi Vgi/J L gi KgiJ 


This result shows in detail how multiple convolution enters into the amplitude 
distribution for only a single convolution connecting the input and output se¬ 
quences. There is reason to think, therefore, that our sequence {tjJ illustrates a 
widespread phenomenon, as regards its approximately normal amplitude distri¬ 
bution. However, this is not its only characteristic. We now have to consider the 
correlation that has been introduced between one term and the next. Successive 
terms are now clearly correlated, for each is the sum of ten numbers, nine of them 
common. 


EFFECT ON AUTOCORRELATION 

To examine the correlation between successive values of the sequence {rj,} of Fig. 
17.3, a plot of 7 j f+1 versus tj, may be constructed as in Fig. 17.7. The points, which 
are numbered serially, reveal the strong correlation; evaluating the correlation as 
before by counting the points in the quadrants defined by the medians, we find 
a value of (18 — 2)/20 = 0.8. A similar calculation of the correlation of tj , +2 gives 
0.6, and so on, with decreasing values. These graphical calculations, which are 
quite speedy and visually informative, form a useful tool for practical data analy¬ 
sis. However, we now wish to calculate the correlation theoretically. 

Consider the product-moment correlation coefficient. Let the sequence { 17 J 
have N terms, let M a be the mean of the first N - r terms, where r = 0,1,2, ..., 
and let M 2 be the mean of the last N — t terms. Then the correlation coefficient 
is defined by 

Sfa+r ~ - Mi) 

[ 2(7? t+T - M 2 ) 2 S(7? f - MO 2 ]* 
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Fig. 17.7 Correlation diagram relating successive pairs of terms of the sequence 7 j f . 
The correlation coefficient is 19 + 9 - (1 + 1)] / 20 = 0.8. 


where the summations run from f — ltof = N — r. There is a certain awkward¬ 
ness in this expression because the means M x and M 2 are unequal and, further¬ 
more, change with t; it is nevertheless the precise expression for the product- 
moment correlation coefficient of a scatter of points (as in Fig. 17.7) about their 
centroid. 

A simple and important result comes out if it is assumed at once that the cor¬ 
relation between one term and the next approaches a limit as the length of the se¬ 
quence increases indefinitely, and if this lim it is calculated. 

For convenience in notation, we restate the problem in terms of sequences re¬ 
ferred to their means in the limit. Thus 



y t = y t - V, 

where 

u = lim -77 
N-* 00 J\J 

and 

n t = Vt ~ Ah 

where 

th. = lim 

N -+00 [\j 

Then 

1 N 1 
lim - Vy, = lim — 

N —*00 * N—xx 


N 

2 

l 

N 

2 

1 


If the relation between these new centroid quantities is 

{n,} = {1111111111}* {y,}. 
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then the relationship is the same as in the original problem where ten consecu¬ 
tive values of y f were added, except for end effects that will be insignificant for 
long sequences. For greater generality, write 

{ n t} = (M * {y»}/ 

where {/,} is a finite but more general sequence than the one previously consid¬ 
ered. Without loss of generality we may, however, restrict {/,} so that 

2 /, = 1 . 

Then the problem to be discussed is this: From a sequence of N uncorrelated ran¬ 
dom digits {y f } form a new sequence {y f } by subtracting the mean, and form lin¬ 
ear combinations {nj by taking the serial product with a sequence {J t }. Find tire 
correlation between members of {nj, in the limit as N tends to infinity. 

The product-moment correlation coefficient between {n f } and itself dis¬ 
placed is 

2n,n t + T 

[2n?2n? +T ]* 


where the summations are suitably carried out. For convenience, we shall write 
this expression in the form 

n, ★ n f 

normalizing factor' 

using the pentagram notation introduced in Chapter 3; it serves here to simplify 
the algebra. In tire following argument we use the result that 

(f*g)*(J*g) = (f*f)*(g + g). 

To derive this result, put f r for the reverse off; then by definition, 

/ +g = fr*g, 

and 

( f*g) + {f*g) = {f*g)r*{f*g)=fr*gr*f*g = fr*f*gr*g 

= (f * f)*(g* g)- 

Now let C(t) be the limiting value of 


n ( ★ n t 

normalizing factor 


for each displacement t as N —> oo. We shall refer to C(r) as the autocorrelation 
function of the sequence {n t }, or of functions for which the sequence stands. Then 


C ( T ) = 


{nj ★ {nj 


normalizing factor 
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= lim 

N—► OO 


-i 


1m 


KM * {y>}] * KM * {y>}] 

normalizing factor 

KM ★ {/,}] * [{y,} ★ {y,}] 

normalizing factor 

KM * {MJ * jjmHyJ * {y,}] 

normalizing factor 

But the members of {yj are uncorrelated; hence 


Um{y,} * {y t } oc {... 0 0 1 0 0 ...} 


and 


C(r) = 


{M * {/,} 


normalizing factor 


Since the normalizing factor was so chosen that C(0) = 1, it follows that the right- 
hand side is a normalized autocorrelation function itself. 

Hence, finally, the autocorrelation of an initially uncorrelated sequence, after 
passage through a filter, is given by the autocorrelation of the impulse response 
of the filter. 


EFFECT ON SPECTRUM 

To consider the spectral effects of passing a noise waveform through a filter, it is 
well to reconsider the ways in which the sequence {*,} may be used to represent 
a waveform. Thus the string of numbers {x f } is fully equivalent to 

/ 

a succession of uniformly spaced impulses of strengths given by the numbers of 
the sequence, and also to the smooth curve 

2*jSinc(f -/), 

/ 

which passes through values given by the sequence. These two expressions have 
quite different spectra; the first has spectral components out to indefinitely high 
frequencies, whereas the spectrum of the second cuts off to zero. The following 
discussion will refer to the second case to avoid reference to two different kinds 
of spectrum, but the results will always be restatable in terms of an impulsive 
signal. 

Spectrum of random input Consider the waveform 

V{t) ='£y J smc(t -j) 
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corresponding to the sequence {y ( }, which has zero mean and equal probability 
of occurrence for the ten possible values that it can assume. What is the spectrum 
of this waveform? 

Taking the Fourier transform directly, 

no => s(/) 

i 

Looking at this result, we see that the transform is zero where |/| > and that 
for smaller values of/ it can be regarded as the vector sum of a set of vectors of 
length y ; , oriented at progressively advancing angles —2tt jf. The length of the 
resultant is the first thing to be calculated; its square will be given by multiply¬ 
ing the Fourier transform above by its complex conjugate. This is what we have 
previously called the power spectrum. It is given by 

ss* = (Sy^'^/Sy, ^ 2 "')n(/) 

= [y? + yi + yi + • - - + 2 (yiy 2 + y^ + y 3 y 4 + - - -) cos 2 t T f 
+ 2(yiy 3 + y 2 y 4 + y 3 y 5 + - - -) cos 4 tt/ + - - ■ ]n(/) 

= {s y/ + 2 (Sym+t) 27Tr f } n (/)- 

The product moments 2y ; y ;+T are not in themselves zero, but the sequence {y,} 
is such that its autocorrelation function is zero for r =£ 0. By the definition, this 
means that 2y y y/ +T becomes negligible relative to 2y*, for all r except t = 0, as 
the number of terms in the sequence increases indefinitely, and hence the first 
term on the right-hand side becomes the dominant contribution. The important 
thing to notice is that this term does not contain the frequency/; in other words 
the power spectrum SS* tends to become flat; it then cuts off at / = 5. 

Had we carried out the discussion in terms of the impulsive waveform 

S(t — j), we would have found a power spectrum that was flat to indefinitely 
high frequencies. 

A difficulty arises over assigning a numerical value to the power spectrum, 
for as is obvious the leading term 2y) itself increases without limit as the length 
of the sequence increases. If a waveform is supposed to contain infinite energy 
(to convey power at a nonzero level for an infinite time), then there is no way of 
avoiding indefinitely large energy per unit bandwidth if all the energy is to be 
packed into a finite band. 

It may be clear already that 2yj is the total energy of the waveform, for 

ll [ Sy, smc (I - j) dl = 

J'>-<f/=2y?. 


and similarly. 
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Of course, it follows from Rayleigh's theorem that these two integrals must be 
equal. One good way of avoiding the difficulty over infinite energy is to deal 
with waveforms of finite duration and to consider whether some quantity un¬ 
der discussion approaches a limit as the duration approaches infinity. The 
strength of the power spectrum happens not to, but the shape of the spectrum 
does. 

From the autocorrelation theorem it follows that if the power spectrum is pro¬ 
portional to Yl(f), then the autocorrelation function will be sine r, and since this 
is equal to unity for r = 0, it is the normalized form; thus 


C(t) = sine r. 

To verify this result directly, we have 

no * no 

C (t) = hm 


n-km normalizing factor 

[ 2yi sinc ( f - /)] * [ 2 Yi sinc (* - ;)J 


= lim 


= lim 


normalizing factor 

j[2y/ 6 (* - /)J*smcfj* j|^2y/ 5 (* - 


* sme t 


} 


normalizing factor 


= lim 


2 y, 8(t - j) ★ 2 Yi s (t ~ i) * sinc t * sinc t 


normalizing factor 


[ 2 y> 5 ( T ) + 2(2 YjYj^r) S(t - t) * sinc r 

Urn- T -^— L ----- 

normalizing factor 

£ 2 y? 5 (*)J * sinc T 

normalizing factor 

2 y ) sinc T 

normalizing factor 


= sinc r. 


Speaking in terms of the impulsive waveform 2y; 8(t — j) we would have 
found C(t) = S°(0, where 5°(r) is the null function that is equal to unity at r = 0 
and is equal to zero elsewhere, but some awkwardness would have arisen. For 
one thing, we wish C(t) to be the Fourier transform of the power spectrum, but 
the transform of a null function is zero; therefore, as a consequence of introduc¬ 
ing infinite-energy pulses in infinite numbers we would have to put up with a 
power spectrum that was flat out to infinite frequency, but equal to zero. It may 



chapter 17: Random Waveforms and Noise 


461 


be noted, however, that the impulsive waveform proved convenient to introduce 
in the derivation given above. 

Finally, the phase of the Fourier transform should be referred to, but it is suf¬ 
ficient to state here that the phase is equally likely to assume any value between 
0 and 2-n and to suggest as a problem the dependence of the phase on frequency, 
for a waveform of finite duration. 


The output spectrum. When the waveform V(t) is passed through a filter, the 
output waveform W(f) is given by 

W(t) = V(t) * /(f), 

where /(f) is the impulse response of the filter and is related to the sequence {/,}, 
which was previously used to specify the filter, in the usual way, namely, 

1(0 = *2, h sine (t - /). 
j 

It follows that the spectrum of W(f) is given by the product of S(f), the Fourier 
transform of V(t), and T(f), the transfer function of the filter. Thus 

W(f) D S(/)T(/), 

and the power spectrum of the output is given by 

SS*TT*. 

Since the power spectrum of the input waveform becomes flat out to its cutoff at 
|/| = | as the duration of the waveform increases, we put SS* oc FI(/), and hence 
the power spectrum of the output is proportional to 

TT*U(f). 

This is the Fourier transform of 


[/(f) ★ /(f)] * sine f. 


a band-limited function whose representation as a sequence is 


{'.) * {/.}• 


This is exactly in accord with the result found previously for the autocorrelation 
function C(r) of the output, namely. 


C(t) = 


W * Ut) 

normalizing factor 


Evidently a key role is played by {/,} ★ {/,} and by its Fourier transform TT*, 
which may be referred to as the power-transfer function of the filter. 

If two filters {/,} and {/,} are cascaded, the key quantities become 


m * v,}) * ait} * vm 
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and the over-all power-transfer function, which is the product of the separate 
functions. This observation permits handling the problem of random noise with 
any given power spectrum which is passed through a filter. We simply say that 
the given waveform is like noise with a flat spectrum that has already passed 
through one filter. 


SOME NOISE RECORDS 

Figure 17.8 shows a long sample of a noise waveform which was prepared by 
convolving the random digits published by Kendall and Smith (1940) with the se¬ 
quence of binomial coefficients {1 5 10 10 5 1} and putting a smooth curve 
through the points so obtained. Since the mean value of digits distributed ran¬ 
domly from 0 to 9 is 4.5, the derived sequence has a mean of 144; the horizontal 
axis has been shown at this mean value. Let us consider the spectrum of the wave¬ 
form. 

It has already been shown that the autocorrelation coefficients in this situa¬ 
tion will have values proportional to {/,} ★ {/,}, where {/,} represents the impulse 
response of the filter; in the present case the numerical operation of convolution 
with {1 5 10 10 5 1} is equivalent to passage through a physical filter. Indeed 
the analogy is so close that one ordinarily speaks of numerical filtering. Hence 
the autocorrelation sequence for the series prepared as above, after subtraction of 
the mean, is 

(1 5 10 10 5 1} ★ {1 5 10 10 5 1} = {1 10 45 120 210 252 210 120 45 10 1}. 
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Now this binomial sequence may also be expressed as 

{1 l}* 10 , 

and hence it is to be expected from the central-limit theorem that the result will 
be approximately Gaussian. In fact, if values of the Gaussian expression 
252 exp [— 7 t(0.24h) 2 ] are calculated for integral values of n and compared with 
the binomial coefficients, we obtain: 

n 0 1 2 3 4 5 

Gaussian 252 210 122 49 14 3 

Binomial 252 210 120 45 10 1 

For compactness in the expressions that follow, the Gaussian expression will be 
substituted, but it is clear that the more precise results can be calculated just as 
easily. 

Assume that the interpolation between points was carried out by convolution 
with a sine function as in connection with the sampling theorem. Then the auto¬ 
correlation function of the smooth curve is proportional to 

{e * 024T )*m(T)} * sine r 

and its power spectrum is proportional to the Fourier transform 

{ok c ^ * ra v)} n w 

This last expression is approximately equal to 

.-H//0-24) 2 

0.24 

The degree of approximation is high, for the expression is already down to 10 5 
at / = 0.5, where it must cut off abruptly to zero. 

It follows that the noise record illustrated has an approximately Gaussian 
spectrum centered on zero frequency. The amplitude distribution may also be ex¬ 
amined and will be found to be Gaussian to a good approximation. One need not 
hesitate, therefore, to accept the graph as an example of how Gaussian low-pass 
noise may be expected to behave. Many interesting features may be studied on 
the record, such as the general way in which the strength, rapidity, and character 
of the oscillations change as time elapses, and many quantitative questions are 
suggested, such as the rate and distribution of zero crossings, the distribution of 
maxima and minima, and so on. 

Fig. 17.9 shows cases where the spectrum is now centered on a nonzero fre¬ 
quency, and the bandwidth is a fraction of the midfrequency. The top sample was 
constructed by drawing a smooth curve through a set of points {y t }, each of which 
was calculated from the equation 

Vt = flj/t-i + 2 + * t , 

where a = 1.84, b = -0.9, and e, was assigned values uniformly distributed at ran¬ 
dom between —0.5 and 0.5. The basis of this simple procedure is as follows. First, 
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Fig. 17.9 Samples of bandpass noise. 


consider the case in which the term e t is not included and where t is not restricted 
to integral values; thus let y(f) be a function of t whose values at integral values 
of t are y t . Then 

y(t) = [ad(t-l) + b8(t-2)]*y(t). 

This equation is obeyed by a damped oscillation 

Ae~ St cos (lot + a), 

where A and a are an arbitrary amplitude and phase, respectively, and the an¬ 
gular frequency to and the damping constant 8 are related to the constants a and 
b by 

a = 2 — a> 2 — 8 
b «= -(1 - S). 

By inclusion of the random term we obtain the response of the damped resonator 
to random excitation which has a flat spectrum up to the cutoff frequency asso¬ 
ciated with the discrete spacing of successive terms. 

The general character of bandpass noise is seen to consist of an oscillation 
centered on the midfrequency of the band and having an envelope amplitude that 
varies considerably. Close inspection would show that the phase of the oscillation 
drifts at a rate connected with the rate at which the amplitude of the envelope 
varies. 

If the noise were passed through several damped resonators in tandem, each 
like the single one under discussion, the spectrum would approach a Gaussian 
distribution about its midfrequency. As it is, this example does not have a Gauss- 



chapter 17: Random Waveforms and Noise 


465 


ian spectrum, but it does have a Gaussian amplitude distribution to a good de¬ 
gree of approximation. A question arises now that did not arise in connection with 
the low-pass noise sample: what is the distribution of the envelope amplitude? 


ENVELOPE OF BANDPASS NOISE 

To study the envelope of a noise waveform y(f) we need to know its Hilbert trans¬ 
form z(t). Then the amplitude of the envelope is defined, as explained in Chap¬ 
ter 13, by 

{[y(0] 2 + WO] 2 }*. 

Let the probability of finding y(t) between y and y + dy be p y (y) dy, and let the 
probability of finding z(f) between z and z + dz be p z (z) dz. In the case we are con¬ 
sidering p y {y) is Gaussian; let 

P y (y) = ae~ Aayf - 

If, as will be shown in a moment, z(f) has the same distribution, then 

p z (z) = ae'^, 

and if in addition z is independent of y, then the probability of finding y(t) 
between y and y + dy, and simultaneously z(t) between z and z + dz, is 
Py(y)Pz(z) dy dz, where 

p y (y)p z ( 2 ) = flV w (* 2+z2) . 

Then on the (y, z)-plane the two-dimensional probability distribution can be writ¬ 
ten in terms of polar coordinates r and 6: 

p y {y)p z {z) dy dz = a l e~™ 1 ^r dd dr. 

Thus the probability p(r) dr of finding the envelope amplitude {[y(f)] 2 + [z(f)] 2 } 
between r and r + dr is given by 

p(r) dr = fl 2 e -rflV 27rr dr, 

or p(r) = 27 TrcPe'™ 1 ' 1 . 

This is the Rayleigh distribution, some of whose numerical parameters were 
recorded in Chapter 4. It is generally written, with reference to its mean-square 
abscissa (r 2 ), in the form 

PM = 

Now the probability distribution of the Hilbert transform z(t) has to be ex¬ 
amined. The basic idea here is that z(f) has statistics identical to those of y(t); first, 
it has the same power spectrum and autocorrelation function. Regarding y(f) as 
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the superposition of harmonic components in unrelated phases, we see that the 
process of Hilbert transformation, which shifts every Fourier component by a dif¬ 
ferent amount, gives another but independent superposition of the same kind. On 
these assumptions it is thus found that the envelope is distributed according to a 
Rayleigh distribution. 


DETECTION OF A NOISE WAVEFORM 


If a noise waveform y(t) is passed through a linear detector whose output is |y(f)|, 
then it is clear that the output waveform has the same Gaussian probability dis¬ 
tribution as the input waveform, as regards positive outputs. Furthermore, the 
envelope of |y(f)| is the same as the envelope of y{t) and therefore has the same 
Rayleigh distribution. 

If we use a square-law detector whose output is [y(t)] 2 , the envelope V is the 
square of the envelope r of y(t). Thus 

V — t 2 

and dV = 2 rdr. 


Hence, since p v dV = p(r) dr, 


» = <k 


-v/(v) 


This is a truncated exponential distribution. 


MEASUREMENT OF NOISE POWER 


Consider a noise waveform with power spectrum R(/), and suppose that we tire 
required to measure its strength. The signal might be one emerging from a band¬ 
pass amplifier connected to an antenna pointing at a wideband source of elec¬ 
tromagnetic radiation; if the spectrum of the source is flat over the pass band of 
the amplifier, then R(J) may be described as the power-transfer function of the 
reception filter. 

Since the mean value of the signal is zero, it is passed through a detector to 
produce a unidirectional flow of current whose mean will be a measure of the 
strength. A square-law detector will be considered here, and we need to know 
that the output-power spectrum is given by 


2 R(f) ★ 



Rif) df 2 


m 
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In this expression the first term enumerates the number of ways a difference fre¬ 
quency/ (or sum frequency) can be found within the spectrum R(f), and the sec¬ 
ond term represents the unidirectional component. The sum and difference fre¬ 
quencies arise from squaring a combination of harmonic components, as in the 
simple theory of detection of oscillatory signals. 

To measure the mean value it is necessary to reduce the fluctuating part. I^et 
this be done by passing the detected waveform through a linear smoothing filter 
whose power-transfer function is S(/). Then its output has a spectrum 


S(J) {2 R(f) * m + r f" R(f) if «(/»• 

J —CO 


The fluctuations are now reduced relative to the mean; the mean-square fluctua¬ 
tion is 

2 f “ S(f)[R(f) * R(/)] df = 2 R(J) * R(f ) I [“ S(/) df, 

J -oo | o J -co 

and the mean value is 


[S(0)]*f“ R(f)df. 

J -oo 


The ratio of the root-mean-square fluctuation to the mean determines the limit 
to the precision that will be attainable in measuring the mean value, a limitation 
that is universally encountered in the theory of measurement. In this formulation 


rms fluctuation 


2R(/) * RCOlo . 

00 S{f) df 

—oo 

mean 


" m*R <j)if 

—OO 

S(0) 



where W s is the equivalent width (Chapter 8) of the power-transfer spectrum of 
the smoothing filter, given by 


W s = 


r wif 

J -oo __ 

S(0) 


and is a quantity that has been described in Chapter 8 as the autocorrela¬ 

tion width of R(J)- It is the equivalent width of R * R, the function that results 
when R(f), including its negative frequency part, is substituted in the autocorre¬ 
lation integral: 


R * R = f°° R(/')R(/ + /') if. 

J -OO 
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■ TABLE 17.1 

Data for reception and smoothing filterst 


Reception filterf 

Rif) 



Rectangular pass band, f 0 > |A 

1 < 


A 

Two separate rectangular pass bands 



A t + A 2 

Triangular pass band, f 0 > \ A 

<&) 



Single tuned circuit, / 0 A 

I'+m 

“1 

2ttA 

Two isolated tandem tuned circuits, f 0 :» A 

kvh 

| —2 

|ttA 

Gaussian pass band§ expj^ - ^ ^ ^ 


2tt*A 

Smoothing filter 

Sif) 


T 


Takes running means over time T 

sine 2 Tf 

T 

Single RC circuit 

[1 + (27TRC/) 2 ]- 1 

IRC 

Two isolated tandem RC circuits 

[1 + {IttRC/Y]- 2 

4 RC 

Critically damped RLC circuit 

[(£/ + ' ^ 

~ 2 8 L 

R 

Rectangular pass band 

n lw) 

1 

2/o 

Gaussian pass band 

cxp (-^) 

1 

(2^) ! /o 


tBracewell (1962). 

JFor bandwidths such that R( 0) is zero or negligible. 
§The half-power bandwidth is (8 In 2)*A. 


Thus 


/r„ R (/) * Kf)df 

W) * R(/)lo 


It is convenient to write t - — and A/ = |W R * R . Then 

r V c 


rms fluctuation _ 1 

mean ( T ^ 

In the simple situation where the reception filter receives uniformly in a band of 
width A and receives nothing outside this band, and the smoothing filter consists 
of a device that takes an average over a time interval T, then r = T and A/ = A. 
For other shapes of reception filter and other kinds of smoothing filter, the val¬ 
ues of t and A / are presented in Table 17.1. 
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PROBLEMS 

1. Rule of thumb. Before one can measure a signal-to-noise ratio, as, for example, from a 
record such as that of Fig. 17.1, it is first necessary to measure the strength of the noise. 
One way would be to read off values at closely spaced intervals and to calculate the 
root-mean-square value. However, according to a widely quoted rule of thumb, the 
root-mean-square value is one-fifth of the peak-to-peak value. Investigate this 
rule. t> 

2. Accuracy of peak width. From a record like that shown in Fig. 17.1, but in which the 
signal is of Gaussian form rather than double-peaked, the width of the signal at half¬ 
peak level is measured. Assuming that the signal-to-noise ratio is large, calculate the 
standard deviation of the measured width. How many times larger than the root-mean- 
square noise must the peak signal be if the width is to be measured with a standard 
deviation of 5 percent? t> 

3. A noise waveform has a Gaussian amplitude distribution and a certain power spec¬ 
trum. What can be said about the amplitude distribution and power spectrum of its de¬ 
rivative? 

4. Dependence of upcross rate and peak rate on power spectrum, (a) A sequence of ran¬ 
dom numbers with a Gaussian distribution is convolved with a sequence {/J. Let us 
say that successive members of the sequences arc spaced 1 second apart. When one 
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member of the output sequence is negative and the following one is positive we say 
that a positive zero crossing, or upcross, has occurred. Show that the expected number 
of upcrosses per second v is given by 

1 

v = —— arccos y v 


where 


{*} = 


ft}*!*.} 

normalizing factor 


and the normalizing factor is chosen in the usual way so that y 0 = 1. 

(b) Show that knowledge of y 1 is equivalent to knowing the central second difference 
of {yj, or the central curvature of the autocorrelation function (ACF) of the smooth 
curve defined by {I ( } when {!,} is a long sequence. Hence or otherwise show that 
the number of upcrosses per second v is equal to the radius of gyration of the 
power spectrum S(f)S*(f), or 


v 


2 


- (/ 2 )sr ~ 


{Vs(/)S»(/)rf/ 

[“ S(f)S*(f)df 

J -OO 


central curvature of ACF 
central value of ACF 


How would you interpret physically a situation where the integral in the numerator 
did not exist? 

(c) Show that the number of maxima per second in a noise waveform whose power 
spectrum is S(/)S*(/) is equal to the number of upcrosses per second in a different 
waveform whose power spectrum is / 2 S(/)S*(/). t> 

5. (a) The waveform shown in Fig. 17.8 has a Gaussian power spectrum exp (—f 2 /2fl). 

From the information given in the text regarding the construction of the figure, and 
assuming successive calculated values to be 1 second apart, determine f 0 . t> 

(b) It is required to find f 0 for an observed waveform possessing a Gaussian power 
spectrum by counting the number of upcrosses per second. By actual count, esti¬ 
mate the value of the coefficient K in the relation f 0 = Kv, where v is the expected 
number of upcrosses per second. What is the precision of this estimate? t> 

6. Plot i)n. T against r), as in Fig. 17.7 for integral t values up to 10, and graph the correla¬ 
tion against t. 

7. Let p be the product-moment correlation coefficient, and let <p be the simple coefficient 
based on counting the dots in the quadrants of a scatter diagram as in Fig. 17.5. Under 
what circumstances will there be a one-to-one relationship between p and <p? Show 
that 


P = 



is a useful conversion formula. 
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8. Clipping noise peaks. The wideband voltage induced in an antenna by radiofrequency 
radiation from outer space is expected to contain narrow-band signals caused by vari¬ 
ous interstellar molecules. Owing to severe technical difficulties associated with the 
faintness of the signal, computer processing is envisaged in which the received voltage 
is first clipped so as to assume a value of +1 whenever the voltage is positive and -1 
when it is negative. It might seem that information would thereby be lost, but show 
that the autocorrelation function of the original signal is given by 



where C(r) is the autocorrelation function of the clipped signal, and hence that the pres¬ 
ence of a spectral line in the radiation may be deduced by Fourier transformation. O 

9. Artificial random noise. A signal V(t) containing three closely spaced but incommen¬ 
surable frequencies is given by 

V(f) = cos t + cos et + cos vt 

Graph the signal, beginning at unit intervals of t, to gain an impression of the behavior 
for the first few cycles, and then quickly graph the envelope of the signal out to about 
t = 150. The envelope rises and falls in a way reminiscent of narrow-band noise, but 
the amplitude distribution cannot, of course, be Gaussian. Show that in fact the proba¬ 
bility of finding the signal level between V and V + dV is proportional to 

(1 - v 2 )-*nQQ * (2 - v 2 )-*nQQ * (1 - v 2 r*n (0 

Show that the resemblance to Gaussian noise is so great that the amplitude distribution 
of a sample running on for hundreds of cycles would be difficult to distinguish from 
the real thing. t> 

10. Mapping a radio source by coherence measurement The radio waves originating in 
our galaxy and other galaxies arrive at the earth with a strength which, for each direc¬ 
tion of arrival, is specified by a temperature T (a convenient quantity which, in the fre¬ 
quency range concerned, is directly proportional to power per unit frequency interval). 
Two identical antennas immersed in the field are equipped with identical narrow-band 
amplifiers. The amplifier output voltages, which are given by the (complex) time- 
dependent phasors V\(f) and V 2 (t) are transmitted by identical transmission lines 
to a nonlinear circuit which measures the complex quantity F defined by 

( 0 ) 

{Vi(m (o)' 

The quantity T is known as the complex degree of coherence of the field as a function 
of spacing between points occupied by the two antennas. If attention is confined to a 
small solid angle, for example, by the use of directional antennas, show that the sky 
source can be mapped using 
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where T is the Fourier transform of the wanted temperature map T. State the nature of 
the independent variables on which T and T depend. Hint: One approach to this prob¬ 
lem is to deal in terms of a transverse field component F(f) on a remote plane perpen¬ 
dicular to the line of sight (the plane being supposed to be less remote than the sources 
of energy). The quantity T may be introduced as a statistic of this field expressible by 
T oc (F(t)F*(t)>. > 

11. The power-transfer function of an amplifier, as a function of frequency /, is 
exp ( -f 2 / 2B 2 ). The amplifier is followed by a square-law detector, a low-pass filter 
whose power-transfer function is exp (—f 2 /2tf), and a recording ammeter. As an over¬ 
all-gain calibration procedure, a signal from a well-designed noise generator is applied 
to the amplifier and the resulting deflection is read from the record. The noise power 
from the diode has a spectrum that is uniform from a low frequency that is negligible 
compared with B to a high frequency much greater than B and its level is well 
standardized. Show that the rms fluctuation on the record is K times the deflection, 
where 



Suppose that B = 10 4 and b = 10 2 and that the precision requirements are such that 
gain changes of 1 percent should be detectable. Would it take more or less than 1 sec¬ 
ond to establish that the gain had changed by 1 percent? How would you investigate 
gain fluctuations taking place with characteristic times of the order of 5 second? C> 

12. A voltage V' 1 (f) is applied to a band-pass amplifier whose impulse response is 1(f), 
squared by a detector, and smoothed by a low-pass filter whose impulse response is 
/(f). Show that the output voltage V 2 (f) is given by 

v 2 (f) = f ( Vj(f - T 1 )K(r 1 ,T 2 )V 1 (f - T 2 )dT, dr 2 , 

J —00 J -oc 

where 

K( T i/T 2 ) = [ 1 (ti - t)/(t)7(t 2 - r) dr. 

J —OO 

13. The spectrum of a noise waveform with Gaussian amplitude distribution extends up to 
but not beyond a frequency f c . The critical rate of sampling given by the sampling the¬ 
orem is thus 2 f c . Show that the samples are not in general independent, and deduce un¬ 
der what circumstances the samples are uncorrelated. The precision with which noise 
power may be measured is expressible in terms of the square root of the number of in¬ 
dependent measures. Show that the rate of occurrence of effectively independent val¬ 
ues is connected with the autocorrelation width of the power spectrum rather than with 
fr> 

14. Surface tolerance of a reflector antenna. Spherical wavefronts diverging from a point 
source at the focus of a perfect paraboloidal reflector become plane after reflection, but 
because of irregularities in construction permitted by the design, the wavefront emerg¬ 
ing from a certain antenna is corrugated in a way resembling Fig. 17.8. Let y be the de- 
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parture of the wavefront from the plane of best fit, and let A be the operating wave¬ 
length. Show that, at a distant receiving point on the normal to the plane, the received 
power falls below what could be received from a perfect reflector by a factor 

1 

1 + 2 <£ 2 ) 

where 8 = liry/X. The angular brackets signify averaging over the antenna aperture, 
and 2 is a design parameter which is equal to unity if the intended field intensity is the 
same at all points of the emerging wavefront. t> 

15. Random antenna array. A number N of identical antennas, all pointing at the zenith, 
are arranged at random on an area of ground G that is so large that the possibility of 
antennas overlapping does not have to be considered. The antennas are connected to a 
single pair of terminals through equal lengths of transmission line in such a way that 
signals from a distant point source in the direction of the zenith arrive at the terminal 
pair in the same phase. To explore the field-radiation pattern of such a "random array," 
we move the point source about on the surface of a sphere that is large compared with 
C and is centered on the centroid of G, and measure the terminal voltage in amplitude 
and phase. The voltage at the terminals falls off as the point source moves away from 
the zenith, and for each source direction we consider the ensemble-average voltage, 
that is, the average of the voltage phasors produced by all possible arrangements of the 
N antennas within G. Show that the ensemble-average voltage is proportional to the 
voltage that would be received if G were completely filled with antennas, and that the 
field-radiation pattern of the random array is therefore the same, on the average, as that 
of one huge antenna occupying the whole area G. t> 

16. A peak voltmeter contains a diode in series with a resistor and capacitor in parallel. An 
alternating voltage applied across this circuit forces charge into the capacitor during 
brief intervals at the voltage peaks at an average rate that just balances the leakage of 
charge from the capacitor through its shunt resistor. A meter across the capacitor indi¬ 
cates the peak voltage of the applied waveform. Investigate the suitability of such an 
instrument for measuring the rms voltage of a noise waveform. 

17. Turbulent trail. The trail left in the atmosphere by a meteor soon develops many wig¬ 
gles, and the effects of the twisting of the trail are observable by radar, and also by pho¬ 
tography when the persistence of visibility is sufficient. One of the physical causes orig¬ 
inally proposed to explain the distortion was random turbulent motion of the 
atmosphere, the theory of which automatically generates mean-square quantities. To 
test this theory, the trail is supposed to be projected onto a plane, and its slope with re¬ 
spect to, and its departure from, a straight line of best fit are considered. It is deduced 
that the number of upcrosses per unit length v is given by 

root-mean-square slope 
root-mean-square departure 

Investigate this result. 

18. Random noise and linear detector. A zero-mean random noise voltage waveform v(t) 
with standard deviation a is passed through a linear detector so that the output is zero 
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when u(f) is negative but is unchanged when v(t) is positive. The output then passes 
through a low-pass filter. Let us say that the pass band of the filter is so related to the 
spectrum of u(<) that the filter output is tire average of five effectively independent val¬ 
ues of the detector output. The filter output fluctuates about a mean voltage m with a 
standard deviation af. 

(a) Show that 


m = (l/ir'ya 


<r,= 



(b) If the waveform u(f) has a resonance spectrum with a 3-decibel bandwidth of 1000 
hertz centered on 6000 hertz, and if the filter is a digital counter whose output ac¬ 
curately averages the detector output for 5 milliseconds, show that 

(\- 2/tt^ 
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Heat Conduction and Diffusion 


1 he subject of heat conduction holds a special place in Fourier theory, because 
it was Fourier's work on problems connected with heat that led him to expound 
his ideas in his "Theorie Analytique de la Chaleur," published in 1822. In this 
chapter it is shown how Fourier analysis enters into the study of heat flow, so 
that the background of ideas acquired thus far may be directly applied to this 
field. For simplicity only one-dimensional flow of heat is discussed, but this is 
sufficient for our purposes. Furthermore, it will be clear how the Fourier trans¬ 
forms in two and three dimensions would be required in the more general geo¬ 
metrical situation. For general background see Jakob (1957). 

It should not be thought that the ideas of this chapter are confined to heat 
conduction; they refer basically to diffusion and to behavior in general that is de¬ 
scribed by the diffusion equation. Thus the kind of physics involved is the same 
as that governing the diffusion of electrons and holes in semiconductors, the dif¬ 
fusion of electrons in a plasma, or ionized meteor trails in the ionosphere. But for 
convenience the text is written in terms of heat conduction, with some reference 
to electric phenomena in cables. 


ONE-DIMENSIONAL DIFFUSION 


The diffusion equation 


V 2 V 


j_av 

K dt 


or, in its one-dimensional form, 

d 2 V = 1 _dV 
ax 2 K at' 
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is well known as describing the phenomena of heat conduction and diffusion. We 
shall confine attention to the one-dimensional equation, which suffices for the pres¬ 
ent discussion of diffusion, and only differs from the more general equation in 
being less complex geometrically. 

If V(x) is the temperature in a bar in which the heat can flow only in the ±x 
directions, then there will be flow of heat only where there is a gradient of tem¬ 
perature dV /dx. The amount of heat per second, f, which can be urged along the 
bar, is proportional to the temperature gradient and is inversely proportional to 
the thermal resistance r of the material of the bar per unit length. Thus 

/ = 1 dV 
r dx 

The conducted heat, having flowed down the temperature gradient to places 
where temperature is lower, produces a temperature rise, which is proportional 
to the amount of heat accumulating per unit length. The property of the material 
which describes the amount by which the temperature will rise is the thermal ca¬ 
pacitance 1 per unit length, c; the temperature rise is inversely proportional to c. 
The amount of heat accumulated in unit length per second is the difference be¬ 
tween what flows in and what flows out, namely, 91/dx. Thus 

av _ _1. ctf 

dt C dx 

This equation allows for a falling temperature where the received heat is insuffi¬ 
cient to supply what must flow out, that is, where dl/dx is positive, or the rate of 
change of temperature gradient d^V/dx 2 is negative. It will be seen that this tends 
to make V(x) smoother as time progresses, and as we possess quantitative mea¬ 
sures of smoothness we can give a definite meaning to this statement. 

A basic difference between diffusion and wave propagation shows up at this 
point. The smoothness of a stretched string or a water surface in the presence of 
waves described by the (nondissipative) one-dimensional wave equation 

d 2 V _ 1 d 2 V 

dx 2 v 2 df' 

where v is the wave velocity, cannot increase as time elapses, as a general prop¬ 
erty, for the waves described by substituting — t for t are also solutions of the wave 
equation. Under any reasonable definition, therefore, the smoothness of a string 
must remain the same as time elapses. In diffusion, on the other hand, the phe¬ 
nomena are not reversible; a sequence of distributions V would not be compati¬ 
ble with nature if considered in reverse order. 


l For bars of unit cross section, r and c may be translated into conventional quantities by replacing r~ l 
by thermal conductivity and c by volumetric specific heat ps, where p is density and s specific heat. 
The units of r and c are the thermal ohm, or thohm, per meter and the thermal farad, or tharad, per 
meter. The author is indebted to W. Shockley for this information. Obviously, V and 1 are to be mea¬ 
sured in tholts and thamps. 
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From the two equations describing one-dimensional heat flow we obtain, by 
elimination of dl/dx, 

d 2 V dV 

dx 2 dt 

By appropriate redefinition of symbols one can establish the same partial dif¬ 
ferential equation wherever the gradient of a physical quantity V is the driving 
agent causing, in linear proportion, transfer of the same stuff whose accumula¬ 
tion linearly raises V. Examples of such quantities V are the concentration of a 
chemical in solution, the partial pressure of a gaseous constituent of an atmos¬ 
phere, the temperature in a medium, the potential difference between the con¬ 
ductors of a submarine cable, and the concentration of holes or electrons in a semi¬ 
conductor. We choose the cable as our second example because it permits 
representation by a circuit diagram. The conductors have a combined resistance 
r and an electrical capacitance c per unit length. The potential difference is V(x), 
and the current is I(x) in one conductor and — I(x) in the other. The electric charge 
stored per unit length is cV. Any inductive reactance is negligible compared to 
the resistance of the conductors, and conduction currents in the medium sepa¬ 
rating the conductors are negligible in comparison with the displacement current. 
Then the equations 

18V 
r dx 

dV _ 18/ 

dt C dx 

will apply to the cable, and a length dx of the cable may be represented by circuit 
(a) of Fig. 18.1. A finite length of cable may be regarded as a chain (fa) of infini¬ 
tesimal elements (a). The diffusion of heat along a poker whose end has been 
thrust in the fire is analogous to the penetration of charge from a battery into a 
cable (Fig. 18.2). The quantity q = cV is the linear charge density, or, in the ther¬ 
mal case, the quantity of heat per unit length. 


rdx 


I + dl 



vvvv- 


--Charge = cdxV 

cdx - 

- 1 


\dl = cdx 


V + dV 


X 


(a) 


(b) 


Fig. 18.1 Circuit representation of an electrical cable that has only resistance and 
capacitance. 
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Temperature of poker 



Charge density on cable 



Inches 


Miles 


"/V^ r 



€3 


Fig. 18.2 Diffusion of heat along a poker and of electric charge into a cable. 


The irreversibility of time in heat-conduction phenomena can be associated 
with the change of entropy, which increases at the rate 


c(dV/dt) 

V 


dx. 


In the electrical case the irreversibility is associated with the dissipation of energy 
at a rate 

J \ rl 2 dx. 

In the conduction case entropy increases until an isothermal state is reached and 
the flow of heat ceases; in the electrical case the final state of zero energy dissi¬ 
pation occurs when each conductor reaches constant potential and the flow of 
current ceases. 

Does this mean that increase of entropy during heat flow corresponds to con¬ 
version of electrical to thermal energy? No, for the requirement on electrical dis¬ 
sipation holds point by point whereas entropy may decrease at some points while 
increasing at others, only the integral over all points being subject to the require¬ 
ment of monotonic increase. 

It is well known that resistance-capacitance networks are nonoscillatory, a rea¬ 
son being that in the absence of inductance we do not have the two different kinds 
of energy storage element upon which ordinary network oscillations depend. One 
or more pulsations are not excluded from the natural behavior, but if in the be¬ 
ginning (or at any time) there are no negative potentials, then none can subse¬ 
quently develop, as they would in an ordinary oscillatory circuit. Of course, a 
nonisothermal system of heat conductors left to itself never develops tempera¬ 
tures lower than the original minimum. 

The simple di ffusion equation arises in a variety of fields of physics, chem¬ 
istry, and engineering and the same transform approach can be applied to all; dif¬ 
fusion of electrons and holes in semiconductors is one example. Transference of 
a basic theory to a different field is impeded by the nonuniformity of symbols 
and the choice of parameters to which the symbols are assigned. Such relation¬ 
ships are illustrated in Table 18.1- 
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■ TABLE 18.1 

Analogies between diffusion of heat in thermal conductors, diffusion of electric 
current carriers in semiconductors, and propagation of electric signals in a cable 
without inductance or leakage conductance. 

Equation (1) gives the voltage, temperature, and particle density gradients. Equation (2) 
gives the current, heat flow, and particle flow gradients. Eliminating the current I (or / 
or /) leads to the familiar diffusion equations (3). Equation (1) in its three versions states 
that flow is proportional to gradient. Equation (2), which expresses the Kirchhoff law 
= 0 at the input node, corresponds to the continuity equation of fluid dynamics. 

Electric Thermal Semiconductor 


v(*) T T T1—T 


Voltage V (volts) 

Current I (amps) 

Resistance/m r (ft m -1 ) 
Capacitance/m c (F m _1 ) 

I rdx 1 + d J 


<= 


column of earth- 


rpi 

J i ! r 


area A 


Temperature T (kelvins) 

Heat flow / (watts) 

Temperature Km _ 

gradient 

Thermal res./m r„ (thohm m *) 
Thermal capacitance c e 

J + dJ 


I 


r e dx 


T T T 4 

V ZfZcdx V + dV T ; 


-t-vwwv— 


il 


V + dV 

1 


Carrier density n (particles cm 3 ) 
Flow density / (particles cm -2 s' 1 ) 

an/dx (cm*) 

gradient 

(Diffusion const.) 1 D' 1 (s cm -2 ) 
Unity and dimensionless 


T T 


j D-'dx i+ d i 

^-rAWvVV— 

dn 


T 


rl = -dV/dx 
cdV/at = -ai/ax 

av 


- = re¬ 
ar 1 at 


T ^ 
11 

= c 0 dx 

T + dT 

_ 1 

« i 

1 J 

~dx 

n +dn 

_ 1 

r,f = -dT/dx 


D' 1 ; = -dn/dx 

(1) 

c e aT /at - -a]/dx 


an/at = -aj/dx 

(2) 

a 2 T ar 

ax 2 " r<,Ce at 


a*n l av 
a 2 r 0 at 


(3) 


When an electric cable is modeled by equations containing only resistance 
and capacitance per unit length, modification is required if dielectric loss becomes 
significant; in that case conductivity g per unit length may be taken into account 
by inserting in the equivalent circuit a conductance in parallel with the capaci¬ 
tance. When thermal diffusion along a conductor is affected by lateral heat loss, 
the same circuit modification applies. When plasma devices are excited electrically 
at such high frequencies that the kinetic energy of the electrons begins to influence 
behavior, an inductance is to be placed in parallel with the capacitance. If plasma 
density becomes so high that collisions between electrons and plasma particles 
cannot be ignored then that inductance acquires a resistance in series with it. 
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The electric circuit analogy, which is purely mathematical, standing as it does 
for a set of equations based on Kirchhoff's laws, illuminates abstruse equations 
in unfamiliar fields and confers the power of applying physical intuition that one 
may possess from experience in one field to a new discipline. 


GAUSSIAN DIFFUSION FROM A POINT 


Two special cases will now be considered. Let the initial distribution of V at t = 0 
be given by 

A S(x), 


where A is a constant. Then it may be verified by substitution that for subsequent 
values of t, 




In other words the distribution V is a Gaussian one which broadens as t 2 and di¬ 
minishes in amplitude as t* so that the area under it remains constant. The flow 
I is representable by two Rayleigh distributions which broaden as t 2 and diminish 
as The distributions of V and I are shown in Fig. 18.3. At any nonzero value 
of X the values of both V and I pass through maxima before subsiding to zero. 

At any instant after t - 0 the total stored energy in the electrical case is given 
by 


f °° \cV 2 dx = 

) -oo 


1 ^ XC { °° 

^ 47rf J-oo 


e-tfrc/M dx 



A \327rrf/ ’ 



Fig. 18.3 The consequences of a local injection of heat 
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r,(x) 


r,(s) 




Fig. 18.4 The Green's function for the diffusion equation, T t (jc), and its Fourier 
transform. 


Knowing that a concentrated deposit of heat diffuses away in a Gaussian man¬ 
ner as described by 

and bearing in mind the linearity of the diffusion equation, which permits the su¬ 
perposition of different solutions, we may express the diffusion of an arbitrary 
initial distribution Vq(x) in the form of a convolution integral over x: 

v t (x) = r t (x) * v^x). 

At any positive value of t we can say that the distribution V is the convolution of 
the initial distribution with the Gaussian distribution to which a point concen¬ 
tration would have died away in the time t. The function T f (x) would ordinarily 
be referred to as the Green's function for the diffusion equation. It is illustrated 
in Fig. 18.4. 


DIFFUSION OF A SPATIAL SINUSOID 

Special interest now attaches to the Fourier transforms r,(s) of the Gaussian dif¬ 
fusion functions r ( (jt), for Fourier theory can now be introduced via the convo¬ 
lution theorem. We know that 

F,(s) = e -^t rc , 

and note that r,(0) = 1 for all t just as r ( (x) has the same area for all f. It follows 
from the convolution theorem that 

V t (s) = e - 4 ^>y o(s) , 
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which can be interpreted as follows. Suppose V t (x) to be resolved into spatial 
Fourier components having the form g^27rsx. Then each such component decays 
exponentially with time with a time constant 

rc 

4^V ; 

that is, the higher the spatial frequency s, the more rapid the decay, as would be 
expected from the higher temperature gradients associated with the shorter spa¬ 
tial wavelength. For S = 0, that is, for a uniform distribution, the time constant is 
infinite, as, of course, it must be since there is no gradient to cause any heat flow. 

We cam now picture the diffusion of any initial distribution as follows. Sub¬ 
ject the distribution to a low-pass filtering operation in which the filter charac¬ 
teristic is Gaussian and gives no phase change. According to the time which is to 
elapse, adjust the filter so that its width shrinks in proportion to t~K In effect we 
are saying that 

^ 2 t Tsxe~*^^ rc 

represents natural behavior, that (co)sinusoidal distributions remain (co)sinu- 
soidal, simply dying away without changes of spatial frequency and without 
x shift, and that, therefore, Fourier analysis leads to a simple description of the 
diffusion phenomenon. The behavior of distributions depending (co)sinusoidally 
on x can be derived directly from 

d 2 V dV 

—~ = rc — 
dx 1 dt 

by noting that partial differentiation with respect to x will be equivalent to mul¬ 
tiplication by i2.7rs. Then 

(ilTTsfW = rc™, 

where V is the phasor such that the real part of V exp Httsx is the actual distri¬ 
bution. Thus 

V = Ae'V 4 ’ 7 ^, 

where A exp i<t> is an arbitrary complex constant and 

V = Re 

= Ae~^^ ilrc cos (2ttsx + <3>). 

The solution to the one-dimensional diffusion problem has now been pre¬ 
sented in two forms. In the first we follow the evolution of a point concentration 
of heat and express the diffusion of an arbitrary distribution by linear superpo¬ 
sition of the Gaussian humps resulting from each element of the distribution. In 
the second we make a Fourier analysis of the arbitrary distribution and follow 
the fortunes of each harmonic component as it decays exponentially at its own 
rate (Fig. 18.5), then resynthesizing to obtain the result. 
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Fig. 18.5 Exponential decay of sinusoidal distribution, without change of form, at 
rates proportional to the square of the spatial frequency. 


From what has gone earlier we know that the procedure in terms of convo¬ 
lution is one which is conceptually attractive. Both ways of looking at the matter 
are, however, illuminating, and we have shown that they are intimately related 
through the convolution theorem. 

The equivalent electrical circuit suggests a number of further points. Both 1 
and V, the two quantities necessary to specify the state of an electric circuit, are 
naturally regarded as equally important. However, on eliminating V from the ba¬ 
sic equations we find that I satisfies the same differential equation as V; that is, 

d 2 / dl 

dx 2 dt 

Thus the distribution of I behaves with the lapse of time exactly in the manner 
already described for V. For instance, the equation 

i t (x) = r t (x) 

describes the solution to a problem in which the flow is distributed in a Gauss¬ 
ian manner and was initially concentrated at one point only; in other words, the 
problem is what happens when V is a step function having nonzero gradient at 
only one point. The solution for V must be 

- j rr f (x) dx. 

By the principle of duality the inductive-conductive transmission line 
(Fig. 18.6) obeys the same equations we have been discussing, but with V and I 
interchanged. Thus V is proportional to the gradient of I and not vice versa. 

Another possible transmission-line circuit suggests itself, namely the 
capacitive-conductive one shown in Fig. 18.7. Its equations will be 
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if 


Fig. 18.6 


The inductive-conduc¬ 
tive line. 



The capacitive-conduc¬ 
tive line- 


and 

whence 

and I obeys the same third-order partial differential equation. Since one might ex¬ 
pect the simple combination of elements to behave rather simply, it is perhaps 
surprising to see a third-order equation appear where second-order sufficed pre¬ 
viously. Going immediately to the initial sinusoidal distribution for a clue to the 
general character of the phenomena, we have 

d\ 

(i 2tts) 2 = SgV, 

whence V = Ae'V 5 ^ 4 ’^. 

Thus a uniform distribution of V would decay instantaneously, and harmonic spa¬ 
tial distributions would decay with time constants proportional to the square of 
the spatial frequency, extremely fine spatial variations being persistent. By the 
principle of duality we can say that the resistive-inductive line of Fig. 18.8 obeys 
the same differential equation, the roles of V and I being interchanged. 

Solutions to the diffusion equation subject to more general initial and bound¬ 
ary conditions have traditionally been obtained by application of Laplace trans¬ 
form formalism (see Carslaw and Jaeger, 1947; van der Pol and Bremmer, 1955). 


5 -* 


d 3 V 
dx 2 dt 


-SgV, 



The resistive-inductive 
line. 
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SINUSOIDAL TIME VARIATION 


In the a-c theory of transmission lines it is known from experience that the im¬ 
pedance, that is, the ratio of V to f, and the propagation constant provide very 
convenient secondary parameters which for many purposes are more useful than 
the primary ones, in our case r and c. We could expect this superior utility to carry 
over into problems in which alternating excitation arises in heat-diffusion prob¬ 
lems. The characteristic impedance Z 0 is given by 



where to is the angular frequency of excitation and the propagation constant y is 
given by 

y = (itocr) 5 . 

Both Z 0 and y are complex, but since each has its real and imaginary parts equal 
in absolute value, only two real constants are involved (corresponding to the two 
real data r and c). 
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PROBLEMS 

1. Retrodiction. The temperature distribution in a rod is given. It is required to retrace its 
history and to discover the initial (or some earlier) temperature distribution. We know 
that the diffusion equation does not govern the flow of events in reverse. Derive the rel¬ 
evant differential equation. Consider the possibility of inverting the convolution process 
used for proceeding forward in time, and apply the concept of filtering spatial compo¬ 
nents to the problem. t> 

2. The temperature distribution on an infinite bar for which rc — 2500 seconds/square meter 
is given by 

V(x) = 300 + lOe” 300 * 2 + 5e-^. 

Deduce the probable past history of V(x). 
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3. Compare and contrast the reverse diffusion problem with the problem of equalization 
by means of filters. l> 

4. Fluctuation of thermal radiation. The surface temperature at the nearest point of the 
moon is approximately 350 degrees Kelvin for half the month and 150 degrees Kelvin 
for the remainder. (Infrared measurements at times of lunar eclipse show that the sur¬ 
face temperature can fall at a rate of hundreds of degrees Kelvin per hour when the 
sunlight is turned off.) The average temperature of the moon's disk at a wavelength of 
one centimeter is observed to be 240 + 40 cos (a >t ~ \n) in degrees Kelvin, where 
o) = 2.46 X 10 6 radians/second. Explain qualitatively (a) why the variation is cos¬ 
inusoidal; ( b ) why the amplitude is only 40 degrees Kelvin; (c) why full moon at 
microwavelengths comes an eighth of a month later than full moon as optically de¬ 
fined. !> 


5. Electric-thermal analogy. The ohmic dissipation term \rl 2 is a moment-by-moment 
and point-by-point expression of the irreversibility of diffusion of charge in an electric 
cable. Interpret | r/ 2 in the language of heat conduction, identifying it with some ther¬ 
modynamically irreversible process. t> 


6. The increase in entropy dS when a quantity of heat dq is absorbed by unit length of a 
bar, where the temperature is V, is defined by 



Satisfy yourself that the entropy of the whole bar must increase steadily with the 
progress of diffusion, and prove that the increase in entropy as the temperature distri¬ 
bution changes from V 0 (r) to V,(x) is given by 


c 



VoM 


dx = c 


f log V f (x) dx 


+ const. 


Now interpret the expression f log V)(x) dx in terms of voltage distributions over elec¬ 
tric cables, and identify it with some concept from the field of electrical communica¬ 
tions which would be expected to increase with the passage of time. t> 


7. Cylindrical diffusion. A meteorite shooting through the earth's atmosphere leaves a 
trail of a electrons and positive ions per meter, which diffuse away with a diffusion co¬ 
efficient K. Show that the electron density N per cubic meter at a distance r from a point 
on the meteor trail at a time t after the meteorite passes the point is given by 


N = 


_ a e -r’/4Kl 

4ttK1 


If the refractive index of air containing N electrons per cubic meter is given, for radio 
waves of frequency /, by 



show that the surface of zero refractive index is a cylinder whose radius expands to a 
maximum radius of 


3o^ 

/ 
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and shrinks to zero after a total time 



8. A weakly ionized column contains a electrons per unit length distributed so that the 
number per unit area distant r from the axis is N(r). Radio waves of length A incident 
normally on the column are partially reflected. Show that as the column diffuses, in¬ 
terference reduces the echo power by a factor 

|^| | N(r¥ nr dS \ 

where k is the propagation constant 2n/\, x is measured from the axis in the incident 
direction, and dS is an element of area in the transverse plane. t> 

9. Thermal-electrical analogy. Seek a one-dimensional continuous physical system anal¬ 
ogous to the electrical transmission line whose equation was r) 3 V/dx 2 dt = V.t> 

10. Half-order derivative. Show that the flow of heat into a bar is proportional to the half- 
order derivative of the temperature difference applied at one end. 

11. Spherical diffusion. You mix some puddings from an old recipe and hang them in a 
cloth to drain until they are stiff, spherical, homogeneous balls weighing one kilogram 
each. Day after day you pop one into a preheated oven and increase the cooking time 
until one day inspection reveals no soggy uncooked core. You now prepare a ten kilo¬ 
gram pudding. Explain why you think the proper cooking time, after the oven is pre¬ 
heated exactly as before, will be five times as long. 

12. Diffusion. At each of a number of places equally spaced by a distance dona long ditch 
of length L, I simultaneously (at t = 0) drop a quantity Q of liquid fertilizer which 
rapidly diffuses through the stagnant water in the ditch. Let V,(r) be the concentration 
of fertilizer in kilograms/meter as a function of distance x along the ditch at time f. 

(a) Write an expression for the initial distribution V 0 (x). 

(f>) In time, the concentration will be nearly uniform. What constant value will it ap¬ 
proach? 

(c) If I,(x) is the number of kilograms per second flowing in the positive x direction 
at a cross section x at time f, is it true that dV t (x)/dt = —dl,(x)/dx? 

(d) If we Fourier-analyze the initial distribution V 0 (x), what do we get for the initial 
amplitude of the Fourier component whose wavelength is d (spatial frequency 
1/d)? Check your units to make sure that the amplitude you obtain is in kilograms/ 
meter. (You may find it advantageous to solve this problem for an infinitely long 
ditch, which should give the same answer.) 

(e) We allow a long time to elapse, so that the concentration is not quite uniform, but 
we would like to consider just how irregular it is. Write an approximate expres¬ 
sion for V t (x), defining any additional symbols you have to introduce. 

13. Sinusoidal temperature variation. The temperature 0(f) in the soil in degrees Fahren¬ 
heit, a few feet below the surface, is given by 0(f) = 60° + 10° cos (tot - v/ 4), where 
2 it/ to — 1 year, and t = 0 corresponds to midsummer. 
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(a) Give reasons to believe that the vertical heat flow /(f) at the same depth in response 
to the applied temperature variation would also depend sinusoidally on time. 

(b) Assume that /(f) does vary sinusoidally, say /(f) — Z 0 cos (a>t + a). Deduce the 
phase angle a. 

(c) In view of the fact that the soil temperature 0 o (f) at the surface shows pronounced 
diurnal variations, and thus is not of the simple form A + B cos (wt + 0), where w 
has the same value as above, can you explain why the subsurface temperature pro¬ 
duced by the irregular surface input excitation would tend to simple annual sinu¬ 
soidal form? C> 

14. Transmission-line analogue. Describe a mechanical one-dimensional continuous sys¬ 
tem that obeys the one-dimensional diffusion equation. Find an example where such a 
system might arise. E> 

15. Subsurface temperature. On a sunny day the temperature at the surface of the soil rises 
rapidly, reaches a maximum in the early afternoon, and falls sharply around sunset. Ex¬ 
plain why the soil temperature at a depth of 1 m varies essentially sinusoidally with a 
period of 24 h and has a peak-to-peak variation much less than the maximum-to-min- 
imum temperature change at the surface. As representative values, take the soil density 
p as 2000 kg m“ 3 , die specific heat s as 50 J kg" 1 K -1 , and the thermal conductivity k as 
30 Jm" 1 s" 1 K" 1 . > 
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Dynamic Power Spectra 


One can represent an elaborate waveform, such as might be generated by a mi¬ 
crophone responding to a passage of music, by its Fourier series, or spectrum, 
and it can be claimed that any subtlety in the original passage, even the briefest 
pizzicato, is captured in the spectrum, the spectrum being fully equivalent to the 
waveform. But we would have trouble pointing out a feature in the transform 
that corresponds to plucking the string; and if we could find such a feature, it 
would be hard to say, just by looking at the spectrum, at what moment the vio¬ 
lin string was plucked. That is because the Fourier series coefficients are constants, 
independent of time. If we had only the power spectrum it would be impossible 
to say when the string was plucked because the power spectrum is independent 
of choice of the origin of time and does not change if some harmonics are trans¬ 
lated in time with respect to others. It follows that the epoch information must 
be encoded in the phase of the complex coefficients distributed around the nat¬ 
ural frequency of the string (196 Hz if the G-string was plucked). The phase of 
tire 196 Hz coefficient alone would not suffice, because that phase would be com¬ 
patible with a time shift of any number of natural periods. 


THE CONCEPT OF DYNAMIC SPECTRUM 

The ear is equipped for effectively analyzing sound into a bank of frequency bins 
by the use of several thousand flexible hair cells of graded sizes excited by a ta¬ 
pered fluid-dynamic waveguide, the cochlea. But the ear does not merely perform 
a Fourier analysis; the function of the operations performed behind the ear is to 
extract information while the music is in progress. So the ear's frequency-analysis 
filter bank continually furnishes changing individual outputs from which we con¬ 
struct an impression of the actions that originally created the sound. The ear effec- 
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tively attends to the signal in short successive time intervals. When high-frequency 
resolution is needed, as when a violinist plays a drawn out note to match the 
oboist's standard 440 Hz, long time segments are automatically attended to. When 
high time resolution is needed, as for recognition of plosive consonants, attention 
shifts to shorter time segments. These changes are made adaptively as the signal 
flows in. 

Musical notation suggests very aptly the sensation of pitch and duration ex¬ 
perienced by the listener. The notes of high pitch are high on the staff, while time 
flows from left to right. A dynamic spectrogram inherits these two features of mu¬ 
sical notation. 

To describe a spectrum that develops with time involves a compromise be¬ 
tween spectral and temporal resolution that is connected with the uncertainty 
principle of quantum mechanics, a relationship originally emphasized by Dennis 
Gabor (1900-1979) (see Gabor, 1946), the father of holography. Fine spectral res¬ 
olution requires segmentation into longer time slices; fine time resolution results 
from short segments, and thereby accepts lower frequency resolution. 

Computed presentations of recordings of birdsong, speech (Rabiner and 
Schafer, 1978), and various geophysical phenomena have usually been based on 
division of the time signal into short equal segments, each segment then being 
Fourier analyzed into complex coefficients. On each segment of the f-axis, cells 
are stacked vertically to contain the coefficients (Fig. 19.1). The cell height (or 
bandwidth), is inversely proportional to cell width (or duration) in accordance 
with the uncertainty relation; thus the cell shape, or aspect ratio, is the same all 
over the computed presentation. However, the aspect ratio would be different if 
shorter segments were chosen so as not to blur brief transients or if, conversely, 
longer segments were chosen in order to gain better discrimination in frequency. 
Other ways of partitioning the (t,/)-plane will be dealt with after techniques of 
measurement and computation have been explained and some dynamic spectra 
have been illustrated. 



Fig. 19.1 Partition of the (f, /)-plane into cells of width Af and height A f that can¬ 
not have an area less than a certain limit. Each cell is associated with a 
complex number that in (a) is a time sample of the signal and in (d) is a 
transform value. Cases (b) and (c) illustrate frameworks for dynamic 
spectra with different choices of cell height-to-width ratio. 
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THE DYNAMIC SPECTROGRAPH 

Fig. 19.2 shows a dynamic spectrum on the (f,/)-plane constructed from a recorded 
waveform that is too complex to interpret by eye. However, the ear hears the 
waveform as clicks (vertical streaks of short duration and wide frequency spread) 
and long whooshes of descending pitch. Fig. 19.3 shows a representation of speech. 
Seismograms, radar echoes from planetary surfaces and the Earth, electrocardio¬ 
grams, and other time signals can be presented similarly. In each case visual analy¬ 
sis stimulates thought about the physical causes. Such dynamic spectra are ob¬ 
tained with instruments that work in principle as shown in Fig. 19.4. The signal 
waveform s(t) to be analyzed is amplified, the signal is divided N ways, sequen¬ 
tially or simultaneously, and the same s(f) is passed to a bank of N bandpass fil¬ 
ters centered on suitably spaced frequencies fj covering the desired range. The 
center frequencies are uniformly spaced and all the filters have the same band¬ 
width, as indicated by the filter characteristics plotted against the leftmost fre¬ 
quency axis. The output from each filter oscillates close to the center frequency 
appropriate to that filter with an amplitude and phase that vary in time in 



Fig. 19.2 A dynamic spectrum of natural phenomena in the VLF band, recorded at 
Palmer Station in the Antarctic, showing lightning flashes (vertical 
traces) and whistlers (curves), which are lightning signals that have been 
dispersed by propagation through space many earth radii away before 
returning to Earth. The many physically significant features would not 
be apparent from the original waveform record as a function of time 
alone. Courtesy Jerry Yarbrough. 
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Fig. 19.3 A voice print of "bait beat bite boat boot." The vowels are characterized 
by a duration of about one-third of a second and the possession of many 
harmonics of significant strength. The consonants are brief and broad¬ 
band. Continuous hum at 60,120,180, and 240 Hz can be seen, and 
shows amplitude modulation associated with the speech. The decline in 
fundamental frequency (around 100 Hz) from one vowel to the next is 
not associated with intonation but is characteristic of the vowels them¬ 
selves, and can be heard if listened for. The decline in frequency be¬ 
tween utterances becomes more noticeable in the overtones. Frequency 
variation within each utterance is what determines the vowel sounds 
which, if listened to, would identify the accent of the speaker. Courtesy 
Jerry Yarbrough. 

accordance with the signal content in its band as time elapses. Each output sig¬ 
nal is rectified and smoothed, with the results indicated on the right of the fig¬ 
ure, which are then recorded. In practice the dynamic spectrum is recorded as a 
photographic density on film, or presented as a brightness distribution on a screen, 
or recorded digitally. Naturally there are a variety of ways of implementing these 
steps and several kinds of instruments are available commercially. Analogue in¬ 
struments, by the 1950s, were of two kinds typified by the Kay Electric Sonograph 
which scanned a tunable filter from 85 Hz up to 8 kHz and the Raytheon Rayspan 
which used a bank of 420 filters spanning any 10 kHz band in the range up to 
50 kHz. The manufacturers quoted comparable bandwidths (around 40 Hz) and 
resolution times (10 ms). The steps of rectification and smoothing mean that no 
phase information is retained. 

The modem example of a dynamic spectrogram shown in Fig. 19.2 was ob¬ 
tained by first digitizing a signal at a 15 kHz sampling rate and then processing 



chapter 19: Dynamic Power Spectra 


493 



Fig. 19.4 A signal source s(f), amplifier, power divider, and the outputs r ; -(f) from 
a bank of bandpass filters centered on /,. The filter transfer functions 
H ; (/) shown on the left frequency axis all have the same shape; the filter 
impulse responses are lift). On the right, the dynamic spectrum is pre¬ 
sented by profiles generated by rectifying and low-pass filtering the 
bandpass filter outputs. Square-law rectification will yield values of the 
dynamic power spectrum at points (t, f). 


by computer. Resolution is similar to that of the original analogue instruments. 
Dynamic power spectra have long been important tools in ionospheric and mag- 
netospheric studies (Helliwell, 1965), speech analysis (Flanagan and Cherry, 1969), 
music (Pierce, 1983), birdsong, bat chirps, the calls of marine mammals, and other 
underwater sound. 

Some quantitative aspects of dynamic spectral analysis are illustrated by the 
artificial example of Fig. 19.5. A signal waveform shown at the bottom rises and 
falls in strength and has a duration of 0.1 s. During the course of the signal the 
frequency, in some intuitive sense, falls noticeably as witnessed by the increasing 
peak-to-peak spacing exhibited by the waveform as time elapses. The signal was 
constructed from the expression £(t) cos[27r(at 4- \f3t 2 4- |yf 3 )], where E(t) is the 
rising and falling envelope and a = 2200Hz is the initial frequency at t = 0. By 
differentiating the phase at 4- \fit 2 4 jyf 3 (measured in cycles) with respect to t, 
we get the instantaneous frequency f inst — a 4 (3t 4 yt 2 . The figure uses 
/3 = —27,500 Hz s~ l for the drift rate. The term containing y = 95,000 Hz s~ 2 in¬ 
troduces some curvature into the drift as witnessed by the descending curve of 
finst versus time. 

The power spectrum of the signal, shown against the frequency axis, ranges 
from 500 Hz to 2200 Hz approximately, is somewhat skew, and as previously 
noted, fails to convey the drifting character of the signal. If spectral phase is avail¬ 
able, or the Hartley transform H(f) as shown on the left, inversion is possible. 

Each filter has an equivalent bandwidth of 100 Hz; consequently the envelopes 
of the filter outputs all have the same equivalent width (0.01 s). The carrier fre¬ 
quencies can be seen to agree with the center frequencies read from the frequency 
axis. For purposes of the illustration the center frequencies are spaced 200 Hz, 
which is twice the bandwidth, but it would be more practical to use a spacing of 
one bandwidth. To use a spacing narrower than the bandwidth would be redun¬ 
dant, but could improve a grey-scale presentation such as Fig. 19.2. 
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Fig. 19.5 A signal waveform (below) and the responses of a bank of filters illus¬ 
trating the frequency-division approach. The smooth curve on the left 
shows the power spectrum of the signal as a whole. The computed in¬ 
stantaneous frequency is shown by the curve threading the several filter 
responses. 


COMPUTING THE DYNAMIC POWER SPECTRUM 

There are two ways of computing values such as those plotted on the right of 
Fig. 19.4: frequency division and time division. We deal with frequency division 
first, as exemplified by the figure. 

Frequency division. Frequency division means that the incoming signal is si¬ 
multaneously (or sequentially) passed to a series of bandpass filters shown as 
boxes in Fig. 19.4. The center frequencies cover a range from f mm to and may 
be spaced uniformly as illustrated, or uniformly in log /, which makes sense bi¬ 
ologically. 

Let the ;'th filter be centered on frequency The filter bandwidths would 
normally be equal to the frequency spacing or greater or less according to cir¬ 
cumstances. With uniformly spaced frequencies the filter bandwidth is thus in¬ 
dependent of frequency; each such constant-bandwidth filter will respond to an 
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incoming impulse by oscillating in the vicinity of the mid-frequency of its band 
and be modulated by an envelope which is of the same duration for all. With fre¬ 
quencies uniformly spaced in log /rather than/, the band widths, as measured in 
hertz, would increase in proportion to f f, the impulse response of each corre¬ 
sponding constant-Q filter would oscillate near the mid-frequency / y but with a 
shorter duration for higher frequencies. The number of oscillation periods under 
the envelope would be the same for each filter, in fact the impulse responses would 
be identical, but compressed in time by a factor proportional to the mid-frequency. 
In Fig. 19.4, if the input signal was an impulse instead of a gliding tone, the var¬ 
ious responses would be lined up below one another because all filters would be 
stimulated at the same time. Evidently the input signal illustrated is a whistle of 
descending pitch. 

An analogue filter, characterized by its impulse response h(t ), will provide a 
response r(t) = s(t ) * h(t). To compute the response we work with signal samples 
s, taken at a sampling rate from the physical input signal s(f). Then 

s, = s(i/f samp)i where i — 1, 2, 3,... . Represent the filter by discrete values h, of 
h(t) spaced at the same sampling interval 1// Mmp . Then the discrete values of the 
output response {r,} of that filter are given by {r,} = 1 k s^ k h k = {s,} * {/?,}. The 
summation extends over the number of coefficients, possibly 20 or 30, deemed 
necessary to describe the filter. 

This seems straightforward but some practical concerns will be recognized. 
Suppose that / Mmp — 15 kHz. Then frequencies as high as 7.5 kHz will be ade¬ 
quately sampled in theory, but in the presence of a little noise, two samples per 
period is not satisfactory. Consequently, perhaps 4 kHz is as high as one might 
expect reliable results and one would prudently test the performance on actual 
physical signals. But now suppose that s(t) contained components at frequencies 
in the range 8 to 10 kHz, as might arise from those harmonics, equally spaced in 
frequency, that are essential to voice recognition and musical appreciation, or from 
unwanted noise or interference. Samples taken at 15 kHz would be indistin¬ 
guishable from samples of signal components in the range 7 to 5 kHz (aliasing). 
Consequently, assurance would be needed that the analogue sensor with which 
the digital data were acquired rejected inputs with components whose frequen¬ 
cies exceeded half the sampling frequency. 

Convolution by summing is fast computationally when one of the factors, in 
this case {h,}, has relatively few terms, say not greater than about 30. But a prac¬ 
tical concern arises from the choice of sampling interval. If the impulse response 
{hj} varies from filter to filter, then for the lower values of / y the number of coef¬ 
ficients spaced at 1// Mmp is more than is needed for adequate specification of the 
impulse response of those filters, by one or two orders of magnitude. The cost of 
storing unneeded data needs to be avoided. Constant-Q filters do not present this 
concern. 

An alternative method for convolution is to take the Fourier or Hartley trans¬ 
form of the signal, adequately padded by zeros, multiply by the transfer function 
of each filter in turn, and invert the transform. Exactly the same result will be ar- 
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rived at as for time domain convolution; the choice of method will depend on cir¬ 
cumstances, perhaps on speed of computation or perhaps on computer capacity. 
With signals sampled at 15 kHz, which as we have seen may be good only for 
low-fidelity situations where only frequencies up to about 6 kHz are present, a 
5-second recording means 75,000 samples, which makes convolution by trans¬ 
forms impractical in some contexts. Time division is thus introduced. 

Time division. Instead of dividing the signal into numerous frequency bands 
we can begin by gating out a segment of the time signal; two such segments are 
shown in Fig. 19.6 at mid-time epochs f, = 0.03 s and 0.07 s. Each has a duration 
of 0.01 s, as measured by the equivalent width of the profile, or time window, h(t). 
One could gate out a sharp-edged slice, just as one would have taken a sharp- 
edged filter pass band in Fig. 19.4, but Gaussian shading is better. Thus the ear¬ 
lier of the two segments is given by 

f(t) = sity’W- 003 *”?' 




Fig. 19.6 To illustrate time division, two segments taken from the earlier signal 
(broken outline) by multiplication with Gaussian functions 
exp[— ir(t — t) 2 /W 2 ] with equivalent width W = 0.01 s and t = 0.03 and 
0.07 s. Power spectra of six segments are plotted against frequency 
(heavy curves). 
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where W = 0.01 s. The transform of this segment can be computed, then the seg¬ 
ment can be advanced through W/2 and a new transform taken, and so on until 
the complete signal has been covered. This is computationally convenient because 
all the transforms have the same length. 

As an example, if f Mmp = 15 kHz, then 350 samples will suffice to specify /(f) 
over a span 2W. At the edges of this bounded segment, the Gaussian factor is 
27 dB below its peak value, which should be enough to do justice to the signal- 
to-noise ratio in many situations. In the figure a span of 0.02 s is illustrated, and 
the truncation involved can just be seen by eye. If one extended the span to 2.4 W, 
the envelope would be 40 dB down and there would be 420 samples. This is clearly 
practical, leaving leeway for broader segments and larger transforms where finer 
resolution in frequency is appropriate. 

To show the Fourier transform of a time segment in Fig. 19.6 by the power 
spectrum alone means that phase has been abandoned. A dynamic phase spec¬ 
trum also exists and in some applications is valuable. 

Presentation. After the dynamic power spectrum values have been computed 
and stored there is a choice of presentations, including grey-scale renderings us¬ 
ing pixels with different visual densities, diagrams with contours of equal value, 
and numerical matrix printouts. With grey-scale spectra one can enhance desired 
features by choosing a suitable functional relationship between the density and 
the computed value, set thresholds, expand the dynamic range, add false color, 
and so on. 


EQUIVALENCE THEOREM 

Let the Fourier transform in amplitude and phase be calculated at some frequency 
f for some epoch t, by time division, and call it G(f„ / ; ). Will the amplitude and 
phase be the same as obtained at that time t, by frequency division with a filter 
centered at /y? Clearly the answer depends on the filter bandwidth. The filter 
bandwidth should be such that the envelope of the impulse response corresponds 
to the multiplying factor used for gating out the segment centered at f,. Narrow¬ 
ing the bandwidth would spread the response over a longer time and reduce the 
power at f = f,-. 

In terms of frequency division let the response to the signal s(t) from the fil¬ 
ter at fj be rj(t) = /°^ s(t’)h ; (t - t')dt' , where hj(t) is the impulse response of the 
;th filter; the transfer function Hy(/) of that filter is the Fourier transform of the 
impulse response as expressed by Hy(/) = /i ; (f) cxp(—i27rft)dt. In the time 

division approach, one multiples the signal s(t) by a translated time function 
w(t — t,) centered on t = f„ takes the Fourier transform, and then asks whether 
the transform value at / = for the same index pair (t, j), relates to the ampli¬ 
tude and phase of ry(r). The indicated value of the Fourier transform is 
S^ x s(t)w(t — ti)eKp(-i2Trfjt)dt, so the two representations are equivalent if 
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hj(tj ~ t) - w(t — t,) exp(— Htt/ jt). Thus 

r.-(t) = e-W [°° 5(/')H,(/' - fY 2 ”? 1 df = f°° s{t')w{t' - t)e-‘ 2 ^ 1 ' dt’. 

Since H,(/) is of the form H 0 (f ) * S(J — fj), f > 0, it follows that fy(f), the in¬ 
verse Fourier transform of H,(/), is indeed of the form w(t) exp(—iZirfjt), and that 
equality results when the multiplying factor w(t) is chosen to agree with the en¬ 
velope of the filter impulse response. 

If the pass band Hj(f) is Gaussian as described by exp[ 77 (J - f,) 2 /Wj\, then 
the values for the dynamic power spectrum will be the same as results from time 
division when w(t) is also Gaussian and has an equivalent width W that is the 
reciprocal of W f . With W = 0.01 s the corresponding filter bandwidth Wy would 
be 100 Hz, as in fact was used in Fig. 19.5. 


ENVELOPE AND PHASE 

After the filter responses r,(t) have been determined the envelope (and the phase 
if wanted) must be found as described in connection with Fig. 19.4. Rectifying 
with a diode and smoothing with a low-pass filter can readily be simulated in the 
computer. A rough procedure for the power spectrum is to square the response, 
shift half a period, and add; this estimate is [r y (f)] 2 + [r,(f + 1/4/,)J 2 - 

More sophisticated is to determine the instantaneous envelope and phase by 
taking the Hilbert transform of the response (Chapter 13). Although Fig. 19.4 
shows a bank of j discrete filters, and the description of Fig. 19,6 also assumes 
that j is discrete, one is in fact free to think of j as a continuous variable and in¬ 
deed the original Sonograph scanned continuously in frequency. Thus r,(t) can be 
defined in terms of the impulse response hj(t) of the ;th filter as 

t ,(t) = hj(t) * s(t) = [e' w{ ' /W)2 cos 277 // ] * s(t), 

where t and /, are regarded as continuously varying and the impulse sequence 
{hj} is replaced by the impulse response hj(t). For any t and /,, r,(t) has an in¬ 
stantaneous envelope G(t, /,) and phase 4>{t, /,) such that r,(t) = 
Re{G(f,/,y [<«'./,)+«*]} vVe could call Ge‘ <t> the Gabor dynamic spectrum because, 
evaluated at discrete values of t and /,, it is the same as the complex coefficient 
associated with a cell. In this notation the dynamic power spectrum would be 

[ ca //)] 2 

Though much information may be encoded in the phase, phase is not as easy 
to present or interpret as the power spectrum. One way is to construct a half-tone 
display directly from [r,(f)] 2 without smoothing. The diagram will then acquire 
hologram-like fringes in the form of thin, quasiparallel isophase lines passing 
through the zero crossings of r,(f). 

Let r ; be evaluated only for discrete values of t equal to mAf, where At is the 
width of a Gabor cell, let the values of j be related to frequency by / = n j A/, 
where A/ is the critical cell height corresponding to At, and let the complex Ga- 
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bor coefficients for the cells be written a mn . Gabor had in mind that the signal s(f) 
would be expressible in terms of these coefficients by 

s(f) = 22 

m n 

for a rigorous result, m and n need to be fractions less than unity (Bastiaans, 1994). 

Much literature has descended from the paper of Gabor (1946); refer to 
Boashash (1988) and Cohen (1989) for bibliographies and to the Science Citation 
Index under Gabor and later authors. 


USING log/INSTEAD OF / 

We now return to nonuniform partitioning of the (t,/)-plane, first considering the 
example of log/ instead of/on the vertical axis, exactly the same coordinate sys¬ 
tem as is used on a player-piano roll and, before that, on the cylinder of a music 
box. To generate a dynamic power spectrum of this kind, on a frequency-division 
basis, calls for a bank of filters of constant Q with impulse responses such as 

hj(t) = e~ 17,2/72 cos 2-7T f ft, 

where the equivalent width T is inversely proportional to the channel center fre¬ 
quency fj. Thus T = k/fj. Choose k = 2; then there are exactly two cycles at the 
frequency / ; in a time T. A set of such impulse responses at frequencies 
fj = 500, 707,1000,1414, 2000 Hz is shown on the left of Fig. 19.7. Since the du¬ 
ration of each impulse response is now inversely proportional to frequency f jt 
the time resolution has improved as the frequency resolution has deteriorated. 
When the same signal as that of Fig. 19.5 is presented to these filters the responses 
r y (f) are as shown. 

On the 500 Hz channel the impulse response h^t) is of relatively long du¬ 
ration, perhaps 10 ms, while the response r^t) runs on for about 30 ms. On the 
2000 Hz channel the impulse response is 4 times briefer, corresponding to the en¬ 
hanced time resolution; however, the response r 2000 (t) is no briefer than at 500 Hz, 
running on for about 40 ms because of the degraded frequency resolution that ac¬ 
companies the enhanced time resolution. Thus, response is spread over the time 
it takes for the signal tone to slide through the relatively broad frequency response 
H 20 oo(/) of the highest frequency filter. 

It is noticeable that the peak response of r 20 oo(f) occurs later than the moment 
when the instantaneous frequency of the signal passes through the 2000 Hz cen¬ 
ter frequency of the filter. Conversely, if one focuses on a time, the frequency that 
reaches maximum response at that time is less than the instantaneous frequency 
for that time. These significant effects are a direct consequence of the uncertainty 
inherent in the bandwidth-duration inequality. To understand this in terms of an 
analogy, imagine a skewnormal bivariate probability distribution. There is a ridge 
line coinciding with the major axes of the concentric elliptical loci of constant 
probability density p(x, y), which is analogous to our locus of instantaneous fre- 
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Fig. 19.7 The responses of a bank of constant-Q filters whose center frequencies 
fj, and associated bandwidths, increase in geometric progression with a 
frequency ratio V2. Left Impulse responses fy(f) of the filters and their 
transfer functions H ; -(/). Main plot: The responses rfit) to a gliding tone 
whose frequency descends as indicated by curve C. 


quency. The regression lines of y on x and of x on y are analogous to peak time 
versus frequency and peak frequency versus time. 

In some applications, such as chirp radar, an attempt is made to determine 
instantaneous frequency and frequency drift rate to better precision than the 
bandwidth-duration inequality would seem to allow, for example by detecting 
zero crossings. This can be done successfully with electronically generated chirps, 
but if the character of the signal were not known in advance, as in observational 
geophysical research, then the inherent uncertainty would reveal itself when the 
zero-crossing technique was attempted in the presence of signals more compli¬ 
cated than one chirp. 


THE WAVELET TRANSFORM 

A substantial literature (Grossman and Morlet, 1984; Kronland-Martinet, 1987; 
Mallat, 1989; Strang, 1989; Daubechies, 1991; Sheng, 1996) that deals with dynamic 
spectrum analysis depending on constant-Q filters is characterized by the use of 
the term wavelet, which has been given a sharp meaning as follows. Instead of 
the set of responses 

r,{t) = j°°3(I - t’MW = * S,(t) 
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that we generate by convolving various impulse responses with the signal s(t), 
consider the different set generated by 



In this reformulation, the impulse responses change with f, but simply by time 
dilation of a chosen basic wavelet h(t), which might be a Gaussian wavepacket 
but need not. The basic wavelet is chosen to be compact in time and in frequency, 
two conditions that are met by arranging that h(t) is a square-integrable function 
(thus dying out in both directions) and has zero mean (frequency content not 
reaching to d.c.). The impulse responses generated by dilation are called wavelets. 

Using filter banks for the purpose of separately encoding signal bands natu¬ 
rally suggested sampling rates that varied according to the band center and gave 
rise to "subband coding" (see Vetterli, 1984), a technique with evolutionary roots 
in work of Kretzmer (1946). "Wavelet" terminology has now supplanted earlier 
expressions of the same concepts. 

In the customary notation, the wavelet transform is written 

The quantity b having the dimensions of time represents translation in time, while 
the scale factor a, defined as -log 2nf also having dimensions of time, repre¬ 
sents dilation, or stretching, in time. The normalization factor \a |~ 1/2 compensates 
for the stretching to give the wavelets all the same quadratic content. As frequency 
increases, a becomes more and more negative, so the corresponding frequency 
axis points downward instead of upward. The definition of <£(«, b) contains a 
cross-correlation rather than a convolution integral, a distinction that would not 
matter if h( ) was an even function. Nevertheless, the wavelet transform can be 
introduced as a convolution, as was done above, by dealing directly in terms of 
f I instead of a. 

The wavelet transform is thus a highly oscillatory entity and if rectified and 
directly displayed as a half-tone image would present the striations discussed 
above in connection with phase display. Of course, the wavelet transform may be 
smoothed after rectification and presented in the same manner as in Fig. 19.2. The 
main difference would lie in the broadening of the filter bandwidths as |a| in¬ 
creased. If h(t) was chosen as a Gaussian wavepacket, as in Fig. 19.7, that would 
be the only difference. As explained above, if one chose to plot on the (a, t>)-plane, 
the diagram would be inverted and would also be compressed nonlinearly in the 
vertical direction so that a linear frequency drift would appear curved. 

Although the wavelet terminology in its origins simply connoted constant-Q 
filters as distinct from the constant-bandwidth filters discussed by Gabor, several 
mathematical advances of wide-reaching significance quickly occurred. For one 
thing, as Gabor had pointed out, Gaussian elementary signals are not orthogonal. 
This deficiency has been overcome by making use of the freedom of choice of the 
basic wavelet. 



502 


The Fourier Transform and Its Applications 


Ability to invert the wavelet transform has become of importance in data com¬ 
pression, especially of images. When a waveform is represented by cells on the 
(f,/)-plane, the omission, before transmission, of cells with little content, or thresh¬ 
old coding, can clearly compress the data to some extent. The practice in subband 
coding was to omit components beyond a certain level of decomposition, a prac¬ 
tice that has been refined under wavelet theory and competes with the DCT en¬ 
coding of 8 X 8 blocks associated with the now superseded JPEG4 image trans¬ 
mission protocol. Thus the subject of dynamic spectra has broadened beyond the 
simple representation of complicated waveforms by visually interpretable pat¬ 
terns on die ( t , /)-plane. Nevertheless, simple representation based on Gaussian 
elementary signals will continue to be widely practiced, especially as extended 
by the use of spatially variable cell shapes, chirplets, and algorithms that can adapt 
locally to the signal encountered and bring into focus fine structure that has hith¬ 
erto been blurred. 


ADAPTIVE CELL PLACEMENT 

Constant-Q filters have been advocated for the purpose of obtaining an increase 
in time resolution at high frequencies, and in the case of whistlers of descending 
pitch and diminishing frequency drift a better representation would result from 
improved frequency resolution at low frequencies combined with improved time 
resolution at higher frequencies. In the two schemes described so far the cell shape 
and placement did not take the character of the signal into account, the cell shape 
not allowing for local structure on the (f,/)-plane. But there is no reason why the 
cell shape should not be allowed to depend both on time and frequency. One 
might base a specification of cell shape versus cell location on a provisional dy¬ 
namic spectrogram. Of course, tiling the plane with cells of changing shape is not 
necessarily possible without overlap or gaps; however, there is no harm in al¬ 
lowing cells to overlap, as when more filters than necessary are used in order to 
improve presentation, although no information is added. 


ELEMENTARY CHIRP SIGNALS (CHIRPLETS) 

We have seen that the elementary cells on the ( t , /)-plane may have any width 
and height consistent with a lower limit to area, and that the aspect ratio may be 
allowed to vary with frequency. When the lower limit is achieved or approxi¬ 
mated, an elementary signal, as defined by Gabor, exists. It is just the impulse re¬ 
sponse of the analyzing filter. The cell aspect ratio may vary with time if the sig¬ 
nal to be analyzed so suggests. That introduces filters that do not observe time 
invariance, and may adapt to the arriving signal as the ear does. 

To take advantage of this flexibility in computing one would first analyze with 
a suitable choice of fixed time and frequency resolution. Where vertically striated 
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structure was found, analysis could be repeated with better time resolution, at a 
sacrifice of frequency resolution in the direction where little frequency depen¬ 
dence was found. Conversely, areas of horizontal striation could be redone with 
better frequency resolution, while oblique structure would call for chirplets. 

Figure 19.2 showed the dynamic spectrum of a natural phenomenon with a 
multiplicity of descending tones of different strengths but of almost identical 
shape separated by short time delays, new components being received before ear¬ 
lier ones died away. At the low frequencies neighboring components appear to 
merge; how does one know that at higher frequencies the structures presented 
are not already composite but unresolved? Fig. 19.8 considers two simple gliding 
tones with a time separation of one second. A square cell straddling the pair of 
instantaneous frequency loci shows a choice of A/ and At that would not resolve 
the components. Two other rectangular cells representing other choices of ele¬ 
mentary signals, but of the same area, show that making the filter bandwidth nei¬ 
ther narrower (lower right rectangle) nor broader (upper left) can resolve the dual 
structure. Flowever, if the (t, /)-plane could be partitioned into oblique cells as 
shown centered on the earlier of the two components then the structure would 
be resolved. To do this requires filters with impulse responses of the form 

T-V^S[2</t + W *)], 

where the frequency drift rate /3 (negative in the example) could be chosen in ac¬ 
cordance with the degree of obliquity desired. This new elementary' signal, not 
known to Gabor, is called a chirplet and was reported independently at about the 
same time by Mihovilovic and Bracewell (1991, 1992) and Mann and Haykin 
(1992); a chirplet occupies a minimum area on the (t,/)-plane. Computed dynamic 
spectra for the gliding-tone pair confirm that the fine structure is resolvable using 
chirplets. The results also show that in any given time segment when signals of 
two frequencies are both present in a rectangular cell, there will be beats modu- 



Fig. 19.8 Two gliding tones in quick succession that would not be resolved by 

square cells nor by cells elongated vertically (left) or horizontally (right), 
as evidenced by the fact that the cells straddle both frequency loci. 
Oblique cells of the same area could give resolution in the direction nor¬ 
mal to the loci. 
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lating the strength of the time response of the filter. In Fig. 19.2 such beats are seen 
in several places, indicating that several of the apparently simple components are 
in fact composite. Adaptive chirplet analysis can thus be expected to be of impor¬ 
tance in physical investigations, wherever complicated waveforms are recorded. 


THE WIGNER DISTRIBUTION 

Among the various ways of operating on a one-dimensional time function/(f) so 
as to set up a two-dimensional representation on the time-frequency plane, 
Wigner's procedure is one of the oldest. Let the real-valued Wigner distribution 
W(t,f) corresponding to /(f) be 

m,f) = f“ fit + b)/*{t - by-^dr. 

Some examples can be easily established. Thus S(t — T), a unit impulse at f — T 
has a Wigner distribution that is a vertical line crossing the (f, /)-plane at t — T. 
This can itself be written as 8(t — T), a distribution now to be regarded as a func¬ 
tion of two variables, t and/, but independent of/. The Gabor diagram for a click 
would look much the same on a grey-scale rendering, except that the Wigner dis¬ 
tribution is completely free of the fuzziness, associated with the uncertainty prin¬ 
ciple, that is characteristic of Gabor diagrams and the various wavelet transforms. 

As a second example take a chirp signal of constant amplitude whose fre¬ 
quency is /o at t = 0 and increases with time at a rate /3 Hz s -1 , so that the 
instantaneous frequency is / 0 + fit. The Wigner distribution for f(t) = 
exp[i27r(|)8f 2 + f 0 t — c)] is 8(f3t + f 0 - /), a distribution concentrated on the 
straight line / — f 0 + fit. This is in striking agreement with the mental picture of 
what might happen when one steadily turns the frequency knob of a signal gen¬ 
erator. The physical reality of the limits to resolution set by the uncertainty prin¬ 
ciple, however, would not permit an equally clear Wigner distribution for a pair 
of gliding tones /(f) + f(t — Af) nor for a single gliding tone with a Gaussian am¬ 
plitude envelope. 

As a third example, /(f) = cos 2ir/of, a cosine wave of frequency / 0 , which 
would appear as a horizontal band at / = / 0 on a Gabor diagram, has a Wigner 
distribution \8{f + / 0 ) + \8(f - f 0 ) + \8(J) cos 47r/ 0 f. In addition to the hori¬ 
zontal lines at / = ±/ 0 , an interaction term has appeared, in the form of a straight 
line at / = 0, varying in strength with a period \fo as time elapses. This interac¬ 
tion term is a mathematical consequence of the definition and does not have the 
intuitive appeal of the steady lines at / = ±/ 0 . 

Finally consider /(f) = S(f — 1) + 8(t — 5). The Wigner distribution is 
8{t — 1) + S(f — 5) + 28(t — 3) cos Stt/. The horizontal lines that each impulse, 
taken alone, would give rise to, are there, but in addition another has appeared 
at the mean time of occurrence f = 3 and it is modulated in the /-direction. 

The Wigner distribution for a complicated signal made up of many parts, such 
as a speech waveform, would be quite unsuitable for the visual interpretation that 
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the Gabor diagram is useful for. 

The Wigner distribution can readily be inverted; thus, given W(f,/), one ob¬ 
tains the original signal as 

Furthermore, projecting downward onto the time axis yields 

l/(OI 2 = [°° W'Wf 

J -oo 

while projecting horizontally onto the frequency axis yields the power spectrum 

ifa)i 2 = f“ w(tj)dt. 

J -oo 

The total quadratic content of f(t) equals the volume under the Wigner distribution: 

f OO _ f oo f oo 

l/(f)| 2 = W(t,f)dtdf. 

J -oo J -oo J -oo 

The Wigner distribution proves to have applications to optics that have dis¬ 
tinguished it as a tool for thinking about existing systems. Consider that the 
Wigner distribution of the Fourier transform F( ) of the signal f(t) is W(—f, t ), 
which is the same as the distribution W(t, /) rotated through 90°. In a graded in¬ 
dex fiber (Chapter 13), the spatial field distribution in the input aperture converts 
itself to its Fourier transform in a distance L that is calculable from the refractive 
index distribution in the transverse plane. At intermediate locations one ath of the 
distance L from the input, the field is expressible as a fractional Fourier transform 
of order a of the aperture distribution. Lohmann (1993) has described a direct con¬ 
nection with rotation of a Wigner distribution by one ath of 90°, while further con¬ 
nections with wavelets, chirp transforms, and optical diffraction are dealt with by 
Ozaktas et al. (1993). 
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PROBLEMS 

1. Wavelet definition. A basic wavelet h(t) has a Fourier transform H(/). {a) Show that the 
Fourier transform of |a| -1/2 fc[(f — b)/a] has the same quadratic content as H(/). (b) Al¬ 
ternatively, if wavelets were constructed from the basic wavelet as |a:| _1 fc[(f — b)/a], 
show that the Fourier transforms would all have the same value at / = 0. 


2. Scaling function. A function <p{x) is to satisfy a dilation equation cf>(x) = 
c 0 (}>{2x) + C]d>(2x - 1) + c 2 <£( 2x - 2) + c^{2jc - 3) + ...,k = 0,1,2,3, ..., which says 
that </i(x) can be broken into a finite sequence of shifted copies of the compressed func- 
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tion <f>(2x). The allowed shifts are \k, i.e„ 0, l\, . - ■ , and arbitrary coefficients c k are al¬ 

lowed. (a) Show that A(x - 1) satisfies the dilation equation and give the coefficients c k . 
(b) If A(x - 1) is represented by samples spaced Ax = i.e., by {0 1 2 1 0}, is the dilation 

equation satisfied? (c) Is the dilation equation satisfied by the Haar wavelet defined by 
4>{x) = n(x) sgn(-x)? 

3. Slide whistle. A sound lasts for one second during which the amplitude rises and then 
falls, while the pitch rises from 200 to 400 Hz and then falls. Write an expression that is 
consistent with the sound pressure signal during this occurrence. > 

4. Screeching halt. A train approaching a road crossing is braking to a halt with an accel¬ 
eration —g and blowing its whistle. The fundamental frequency of the whistle, at rest, is 
550 Hz. (a) Write an expression for the acoustic air pressure signal s (t) at the crossing. I> 

5. Mean frequency. A signal s(f) has a Fourier transform S(/) and a power spectrum |S(/)| 2 , 
which does not go negative, and in that respect resembles a mass distribution along a 
line. Define the mean frequency of a signal s(f) as the centroid of the mass distribution 
that corresponds to the power spectrum, i.e., by 

f“ f\m 2 df 

J -OO __ 

\S(f)\ 2 df 

(a) Under this definition, what is the mean frequency for a signal 
s(f) = exp[-7r(10 -5 f) 2 ] cos 27r60t? (b) What is the root-mean-square deviation of 
the power spectrum of this highly monochromatic signal from its mean frequency? 
(c) The waveform s(f) is to be subjected to time-frequency analysis. What would be 
a suitable choice of cell size and shape? > 

6. A simple waveform. A signal s(f) = J 0 (27rt), which approaches a frequency of 1 Hz as 
|f | —>■ oo, would appear to have a lower frequency in the vicinity of t = 0, perhaps reach¬ 
ing about 2/3 Hz. How could this departure from monochromaticity be displayed on the 
(/, f)-diagram? t> 


7. Fourier transform of Haar wavelet Derive the transform 

F(s) = (7rs) _l (l — COS 7rs)(sin 7TS + i cos 7rs) 

for the Haar wavelet defined by /(x) = 1 where (0 < x < \), /(x) = — 1 where 
(j < x < 1), and /(x) = 0 where x < 0 or x > 1.1> 

8. Wigner distribution theorems. If/(f) has Wigner distribution W(t,f), show that 

/(—f) has W.D. W(-f,-/) (tt rotation) 

af(t) has W.D. |a| 2 W(£, /) (nonlinearity) 

f(at) has W.D. -pr W(at, f/a) (similarity). 

9. Wigner distribution for Gaussian pulse, (a) Show that f{t) = exp(-7rf 2 /W 2 ) has Wigner 
distribution W(t,/) = V2W exp[-27r(f 2 /W 2 - W 2 / 2 )]. (b) For a given equivalent width 
W, what is the shape of the loci W(f, /) = const? 
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Tables of sine x, sine 2 x, and exp (— ttx 2 ) 


In this table, the well-normalized functions sine x, sine 2 x, and exp (— ttx 1 ) are tab¬ 
ulated to six decimal places from 0 to 3.99. The definition of sine x is 


sine x = 


sin ttx 

TTX 


Table of sine x, sine 2 x, and exp (—irx z ) 


X 

sine x 

sine 2 x 

exp (—irx 2 ) 

X 

sine x 

sine 2 

X 

exp (- 

TTX 2 ) 

.00 

1.000 000 

1.000 000 

1.000 000 

.25 

.900 316 

.810 

569 

.821 

725 

.01 

.999 886 

.999 671 

.999 686 

.26 

.892 454 

.796 

473 

.808 

664 

.02 

.999 34* 

.998 685 

.998 744 

.27 

.884 325 

.782 

031 

.795 

311 

.03 

.998 5*0 

.997 043 

.997 177 

.28 

.875 936 

.767 

263 

.781 

687 

.04 

.997 370 

.994 747 

.994 986 

.29 

.867 290 

.752 

192 

.767 

814 

.05 

.995 893 

.991 802 

.992 177 

.30 

.858 394 

.736 

840 

.753 

713 

.06 

.994 089 

.988 212 

.988 754 

.31 

.849 251 

.721 

228 

.739 

407 

.07 

.991 959 

.983 983 

.984 724 

.32 

.839 869 

.705 

379 

.724 

916 

.08 

.989 506 

.979 121 

.980 095 

.33 

.830 251 

.689 

316 

.710 

263 

.09 

.986 729 

.978 634 

.974 874 

.34 

.820 403 

.673 

061 

.695 

470 

.10 

.983 632 

.967 531 

.969 072 

.35 

.810 332 

.656 

638 

.680 

556 

.11 

.980 215 

.960 821 

.962 700 

.36 

.800 048 

.640 

068 

.665 

544 

.12 

.976 481 

.953 515 

.955 769 

.37 

.789 542 

.623 

376 

.650 

454 

.13 

.972 432 

.945 623 

.948 292 

.38 

.778 834 

.606 

588 

.635 

808 

.14 

.968 070 

.937 159 

.940 282 

.39 

.767 927 

.589 

712 

.620 

124 

.15 

.963 398 

.928 135 

.931 755 

.40 

.756 827 

.572 

787 

.604 

923 

.16 

.958 418 

.918 566 

.922 724 

.41 

.745 539 

.555 

828 

.589 

728 

.17 

.953 135 

.908 466 

.913 208 

.42 

.734 070 

.538 

859 

.574 

5 45 

.18 

.947 550 

.897 851 

.908 221 

.43 

.722 428 

.521 

902 

.559 

406 

.19 

.941 667 

.886 736 

.892 783 

.44 

.710 618 

.504 

977 

.544 

323 

.20 

.935 489 

.875 140 

.881 911 

.45 

.698 647 

.488 

107 

.529 

315 

.21 

.929 021 

.863 080 

.870 625 

.46 

.686 522 

.471 

312 

.514 

396 

.22 

.922 265 

.850 573 

.858 943 

.47 

.674 249 

.454 

612 

.499 

585 

.23 

.915 227 

.837 640 

.846 885 

.48 

.661 837 

.438 

028 

.484 

895 

.24 

.907 909 

.824 298 

.834 472 

.49 

.649 291 

.421 

579 

.470 

341 
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Table of sine x, sine 2 x, and exp ( cont’d ) 


X 

sine x 

sine 2 x 

1 

/— s 

1 

4 

X 

sine x 

sine 2 x 

exp (—7ri 2 ) 

.50 

.636 

620 

.405 285 

.4 55 938 

1.00 

.000 000 

.000 000 

.043 214 

.51 

.623 

829 

.389 163 

.441 698 

1.01 

— .009 899 

.000 098 

.040 570 

.52 

.610 

926 

.878 231 

.427 634 

1.02 

— .019 595 

.000 884 

.088 063 

.53 

.597 

919 

.357 507 

.413 758 

1.03 

-.029 083 

.000 846 

.085 689 

.54 

.584 

815 

.342 008 

.400 081 

1.04 

-.088 360 

.001 472 

.033 442 

.55 

.571 

620 

.326 749 

.386 613 

1.05 

-.047 423 

.002 249 

.031 317 

.56 

.558 

342 

.811 746 

.373 363 

1.06 

-.056 269 

.003 166 

.029 308 

.57 

.544 

989 

.297 013 

.360 341 

1.07 

-.064 895 

.004 211 

.027 411 

.58 

.531 

568 

.282 565 

.347 555 

1.08 

-.073 297 

.005 372 

.025 621 

.59 

.518 

086 

.268 413 

.335 012 

1.09 

-.081 473 

.006 638 

.028 932 

.60 

.504 

551 

.254 572 

.322 719 

1.10 

-.089 421 

.007 996 

.022 341 

.61 

.490 

970 

.241 051 

.810 682 

1.11 

— .097 138 

.009 436 

.020 843 

.62 

.477 

350 

.227 863 

.298 905 

1.12 

-.104 628 

.010 946 

.019 432 

.63 

.463 

699 

.215 017 

.287 395 

1.13 

-.111 873 

.012 515 

.018 106 

.64 

.450 

024 

.202 522 

.276 154 

1.14 

— .118 886 

.014 134 

.016 860 

.65 

.436 

333 

.190 386 

.265 186 

1.15 

-.125 661 

.015 791 

.015 690 

.66 

.422 

632 

.178 618 

.254 494 

1.16 

-.132 196 

.017 476 

.014 591 

.67 

.408 

929 

.167 223 

.244 080 

1.17 

— .138 490 

.019 179 

.013 561 

.68 

.395 

282 

.156 209 

.233 944 

1.18 

-.144 541 

.020 892 

.012 596 

.69 

.381 

548 

.145 579 

.224 089 

1.19 

-.150 350 

.022 605 

.011 692 

.70 

.367 

883 

.185 338 

.214 514 

1.20 

— .155 915 

.024 809 

.010 847 

.71 

.354 

245 

.125 490 

.205 219 

1.21 

-.161 235 

.025 997 

.010 056 

.72 

.840 

642 

.116 037 

.196 204 

1.22 

-.166 310 

.027 659 

.009 317 

.73 

.327 

079 

.106 981 

.187 467 

1.23 

-.171 140 

.029 289 

.008 627 

.74 

.313 

565 

.098 323 

.179 006 

1.24 

-.175 724 

.030 879 

.007 982 

.75 

.300 

105 

.090 063 

.170 820 

1.25 

-.180 068 

.082 423 

.007 382 

.76 

.286 

708 

.082 201 

.162 906 

1.26 

-.184 157 

.033 914 

.006 822 

.77 

.273 

879 

.074 736 

.155 261 

1.27 

-.188 006 

.035 346 

.006 301 

.78 

.260 

126 

.067 666 

.147 881 

1.28 

-.191 611 

.086 715 

.005 816 

.79 

.246 

955 

.060 987 

.140 764 

1.29 

-.194 972 

.038 014 

.005 365 

.80 

.233 

872 

.054 696 

.133 906 

1.30 

-.198 091 

.039 240 

.004 045 

.81 

.220 

885 

.048 790 

.127 301 

1.31 

-.200 968 

.040 388 

.004 556 

.82 

.207 

999 

.043 263 

.120 947 

1.32 

-.203 604 

.041 455 

.004 195 

.83 

.195 

220 

.038 111 

.114 837 

1.33 

-.206 002 

.042 437 

.003 860 

.84 

.182 

556 

.038 327 

.108 967 

1.34 

-.208 162 

.043 331 

.003 549 

.85 

.170 

Oil 

.028 904 

.103 333 

1.35 

-.210 086 

.044 136 

.008 262 

.86 

.157 

593 

.024 835 

.097 928 

1.36 

-.211 776 

.044 840 

.002 995 

.87 

.145 

806 

.021 114 

.092 748 

1.37 

-.218 234 

.045 469 

.002 749 

.88 

.133 

156 

.017 781 

.087 786 

1.38 

-.214 462 

.045 994 

.002 522 

.89 

.121 

150 

.014 677 

.083 038 

1.39 

— .215 462 

.046 424 

.002 311 

.90 

.109 

292 

.011 945 

.078 497 

1.40 

-.216 236 

.046 758 

.002 117 

.91 

.097 

589 

.009 524 

.074 158 

1.41 

-.216 788 

.046 997 

.001 939 

.92 

.086 

044 

.007 404 

.070 015 

1.42 

-.217 119 

.047 141 

.001 774 

.93 

.074 

664 

.005 675 

.066 062 

1.43 

-.217 234 

.047 190 

.001 622 

.94 

.063 

452 

.004 026 

.062 293 

1.44 

-.217 133 

.047 147 

.001 482 

.95 

.052 

415 

.002 747 

.058 702 

1.45 

-.216 821 

.047 011 

.001 353 

.96 

.041 

557 

.001 727 

.055 283 

1.46 

-.216 301 

.046 786 

.001 235 

.97 

.030 

882 

.000 954 

.052 031 

1.47 

-.215 576 

.046 473 

.001 126 

.98 

.020 

395 

.000 416 

.048 939 

1.48 

-.214 650 

.046 075 

.001 027 

.99 

.010 

099 

.000 102 

.046 002 

1.49 

-.213 525 

.045 593 

.0,9 353 



Table of sine x , sine 2 x , and exp (—vx 2 ) (cont’d) 


X 

sine 

X 

sine 

X 

exp ( 

— irX 1 ) 

1.50 

-.212 

207 

.045 

032 

-0 a 8 

514 

1.51 

-.210 

697 

.044 

393 

.0,7 

746 

1.52 

-.209 

001 

.043 

681 

.0 3 7 

043 

1.53 

-.207 

122 

.042 

900 

.0,6 

399 

1.54 

-.205 

065 

.042 

052 

.0,5 

811 

1.55 

-.202 

833 

.041 

141 

.0,5 

273 

1.56 

-.200 

431 

.040 

172 

.0,4 

782 

1.57 

-.197 

862 

.039 

150 

.0,4 

335 

1.58 

-.195 

133 

.088 

077 

.0,3 

926 

1.59 

-.192 

246 

.036 

958 

.0,3 

554 

1.60 

-.189 

207 

.035 

799 

.0,3 

215 

1.61 

— .186 

020 

.084 

603 

.0,2 

907 

1.62 

-.182 

690 

.083 

875 

.0,2 

626 

1.63 

-.179 

221 

.032 

120 

.0,2 

371 

1.64 

-.175 

619 

.080 

842 

.0,2 

140 

1.65 

-.171 

889 

.029 

546 

.0,1 

980 

1.66 

-.168 

034 

.028 

236 

.0,1 

739 

1.67 

-.164 

061 

.026 

916 

.0,1 

566 

1.68 

-.159 

975 

.025 

592 

.0,1 

410 

1.69 

-.155 

780 

.024 

267 

.0,1 

268 

1.70 

-.151 

481 

.022 

947 

.0,1 

140 

1.71 

-.147 

084 

.021 

634 

.0,1 

024 

1.72 

-.142 

594 

.020 

333 

.0,9 

197 

1.73 

-.138 

016 

.019 

048 

.0,8 

252 

1.74 

-.133 

355 

.017 

784 

.0,7 

400 

1.75 

-.128 

617 

.016 

542 

.0«6 

631 

1.76 

-.128 

806 

.015 

828 

.0,5 

939 

1.77 

— .118 

928 

.014 

144 

.0*5 

816 

1.78 

-.113 

988 

.012 

993 

.0,4 

755 

1.79 

-.108 

991 

.011 

879 

.0,4 

250 

1.80 

— .103 

943 

.010 

804 

.0,3 

797 

1.81 

-.098 

849 

.009 

771 

.0,3 

390 

1.82 

-.093 

714 

.008 

782 

.0,3 

024 

1.83 

-.088 

543 

.007 

840 

.0,2 

697 

1.84 

— .083 

341 

.006 

946 

.0 4 2 

403 

1.85 

-.078 

113 

.006 

102 

.0,2 

140 

1.86 

-.072 

865 

.005 

309 

. 0 4 1 

905 

1.87 

-.067 

602 

.004 

570 

.oa 

694 

1.88 

-.062 

329 

.003 

885 

.ou 

506 

1.89 

-.057 

050 

.003 

255 

,oa 

338 

1.90 

— .051 

770 

.002 

680 

.o 4 l 

187 

1.91 

-.046 

495 

.002 

162 

-04 

053 

1.92 

-.041 

229 

.001 

700 

.0s9 

340 

1.93 

-.035 

978 

.001 

294 

.058 

276 

1.94 

-.030 

745 

.000 

945 

.0s7 

329 

1.95 

-.025 

536 

.000 

652 

.0,6 

486 

1.96 

-.020 

354 

.000 

414 

.0,5 

736 

1.97 

-.015 

206 

.000 

231 

.0,5 

070 

1.98 

-.010 

094 

.000 

102 

.0,4 

478 

1.99 

-.005 

024 

.000 

025 

.0 5 S 

953 


X 

sine 

X 

sine* x 

exp ( 

—irx 3 ) 

2.00 

.000 

000 

.000 

000 

.0,3 

487 

2.01 

.004 

974 

.000 

025 

.0,3 

075 

2.02 

.009 

894 

.000 

098 

.0,2 

709 

2.03 

.014 

756 

.000 

218 

.0,2 

385 

2.04 

.019 

556 

.000 

382 

.0,2 

099 

2.05 

.024 

290 

.000 

590 

.0,1 

846 

2.06 

.028 

954 

.000 

838 

.0,1 

622 

2.07 

.033 

545 

.001 

125 

.0,1 

425 

2.08 

.038 

058 

.001 

448 

.0,1 

251 

2.09 

.042 

491 

.001 

805 

.0,1 

097 

2.10 

.046 

840 

.002 

194 

.0,9 

618 

2.11 

.051 

101 

.002 

611 

.0*8 

427 

2.12 

.055 

272 

.003 

055 

.0,7 

378 

2.13 

.059 

350 

.003 

522 

.0,6 

456 

2.14 

.063 

332 

.004 

Oil 

.0,5 

645 

2.15 

.067 

214 

.004 

518 

.0,4 

934 

2.16 

.070 

994 

.005 

040 

.0,4 

309 

247 

.074 

670 

.005 

576 

.0,3 

761 

2.18 

.078 

238 

.006 

121 

.0,3 

280 

2.19 

.081 

697 

.006 

674 

.0,2 

860 

2.20 

.085 

044 

.007 

233 

.0,2 

491 

2.21 

.088 

278 

.007 

793 

.0,2 

169 

2.22 

.091 

396 

.008 

858 

.0,1 

887 

2.23 

.094 

396 

.008 

911 

.0,1 

641 

2.24 

.097 

276 

.009 

463 

.0,1 

426 

2.25 

400 

035 

.010 

007 

.0,1 

238 

2.26 

.102 

672 

.010 

541 

.0,1 

075 

2.27 

.105 

184 

.Oil 

064 

.0,9 

322 

2.28 

.107 

571 

.011 

572 

.O78 

080 

2.29 

.109 

832 

.012 

063 

.0,7 

000 

2.30 

.111 

964 

.012 

536 

.O76 

060 

2.31 

413 

969 

.012 

989 

.0,5 

243 

2.32 

415 

844 

.013 

420 

.0,4 

533 

2.33 

417 

589 

.013 

827 

.0 7 S 

917 

2.34 

.119 

204 

.014 

210 

.O7S 

382 

2.35 

.120 

688 

.014 

566 

.0 7 2 

919 

2.36 

422 

040 

.014 

894 

.0,2 

518 

2.37 

.123 

262 

.015 

193 

.0 r 2 

170 

2.38 

424 

852 

.015 

463 

.0 7 1 

869 

2.39 

.125 

310 

.015 

703 

.0 7 1 

609 

2.40 

.126 

138 

.015 

911 

.0 7 1 

384 

2.41 

426 

834 

.016 

087 

.0 7 1 

190 

2.42 

.127 

401 

.016 

231 

,0 7 1 

023 

2.43 

.127 

837 

.016 

342 

.0,8 

780 

2.44 

.128 

144 

.016 

421 

.0,7 

534 

2.45 

.128 

323 

.016 

467 

.0,6 

461 

2.46 

.128 

374 

.016 

480 

.0,5 

538 

2.47 

.128 

298 

.016 

460 

.0,4 

748 

2.48 

428 

097 

.016 

409 

.0g4 

060 

2.49 

.127 

772 

.016 

326 

.0,3 

473 



Table of sine x, sine 2 and exp ( — xx 2 ) (cont’d) 


X 

sine x 

sine 2 

; X 

exp (~ 7TX 2 ) 

X 

sine x 

sine 2 x 

exp ( —7TX 2 ) 

2.50 

.127 324 

.016 

211 

.0„2 969 

3.00 

.000 000 

.000 000 

•0i25 255 

2.51 

.126 754 

.016 

067 

.0„2 537 

3.01 

-.003 322 

.000 011 

.0 12 4 351 

2.52 

.126 064 

.015 

892 

.0 8 2 166 

3.02 

-.006 618 

.000 044 

.0i 2 3 600 

2.53 

.125 256 

.015 

689 

.0 8 1 848 

3.03 

— .009 886 

.000 098 

.0, 2 2 977 

2.54 

.124 331 

.015 

458 

.0 8 1 576 

3.04 

-.018 128 

.000 172 

.0, 2 2 460 

2.55 

.123 291 

.015 

201 

.0 8 1 348 

3.05 

-.016 326 

.000 267 

.Or2 082 

2.56 

.122 137 

.014 

918 

.0 8 1 144 

3.06 

-.019 492 

.000 880 

.0 12 1 677 

2.57 

.120 873 

.014 

610 

.0»9 787 

3.07 

-.022 618 

.000 512 

.0, 2 1 388 

2.58 

.119 500 

.014 

280 

-0»8 283 

3.08 

-.025 701 

.000 661 

.0 I2 1 140 

2.59 

.118 020 

.013 

929 

.0„7 041 

3.09 

-.028 740 

.000 826 

.0 U 9 393 

2.60 

.116 435 

.013 

557 

.0*5 982 

3.10 

-.031 730 

.001 007 

.0, 3 7 738 

2.61 

.114 748 

.018 

167 

.0*5 078 

3.11 

— .034 670 

.001 202 

.0 l3 6 3 62 

2.62 

.112 961 

.012 

760 

.094 809 

3.12 

-.087 557 

.001 411 

.0„5 231 

2.63 

.111 076 

.012 338 

,0 9 3 654 

3.13 

-.040 389 

.001 631 

.0, 3 4 2 99 

2.64 

.109 097 

.011 

902 

.0s3 096 

3.14 

-.048 162 

.001 863 

.0„S 530 

2.65 

.107 025 

.011 

454 

.0 9 2 622 

3.15 

-.045 876 

.002 105 

-0, 3 2 897 

2.66 

.104 864 

.010 

996 

.0 b 2 219 

3.16 

-.048 528 

.002 355 

.0n2 376 

2.67 

.102 615 

.010 

530 

.0 9 1 877 

3.17 

-.051 114 

.002 613 

.0 13 1 948 

2.68 

.100 283 

.010 

057 

.0 9 1 587 

3.18 

-.053 635 

.002 877 

.Oul 595 

2.69 

.097 869 

.009 

578 

.0 9 1 340 

3.19 

-.056 087 

.003 146 

•Oi 8 l 806 

2.70 

.095 377 

.009 

097 

.0 9 1 132 

3.20 

-.058 468 

.008 419 

.Oi 3 l 069 

2.71 

.092 810 

.008 

614 

•0, 0 9 547 

3.21 

— .060 777 

.003 694 

.0 m 8 736 

2.72 

.090 170 

.008 

131 

.0i O 8 050 

3.22 

-.063 012 

.003 971 

,0 U 7 138 

2.73 

.087 461 

.007 

649 

.Oi 0 6 788 

3.23 

-.065 171 

.004 247 

.0 U 5 829 

2.74 

.084 685 

.007 

172 

.Oi 0 5 7 12 

3.24 

-.067 258 

.004 523 

.0 U 4 757 

2.75 

.081 847 

.006 

699 

.Oi 0 4 807 

3.25 

-.069 255 

.004 796 

.0 U 8 879 

2.76 

.078 949 

.006 

238 

•Oio4 048 

3.26 

-.071 177 

.005 066 

.0 M S 162 

2.77 

.075 994 

.005 

775 

.0 10 3 898 

3.27 

-.078 018 

.005 882 

.0,<2 575 

2.78 

.072 985 

.005 

327 

•0io2 855 

3.28 

-.074 775 

.005 591 

•0 U 2 096 

2.79 

.069 926 

.004 

890 

.0 10 2 896 

3.29 

-.076 448 

.005 844 

.0 U 1 706 

2.80 

.066 821 

.004 

465 

.0n>2 010 

3.30 

-.078 036 

.006 090 

.0, 4 1 387 

2.81 

.063 671 

.004 

054 

.Oiol 686 

3.31 

-.079 537 

.006 826 

.Onl 127 

2.82 

.060 482 

.008 

658 

.O 10 l 412 

3.32 

-.080 951 

.006 553 

.0 1S 9 147 

2.83 

.057 255 

.008 278 

.0, 0 1 188 

3.33 

-.082 277 

.006 770 

.Oi 5 7 428 

2.84 

.053 995 

.002 

916 

.0 U 9 897 

3.34 

-.083 514 

.006 975 

.0| S 6 020 

2.85 

.050 705 

.002 

571 

.0i,8 277 

3.35 

-.084 662 

.007 168 

.0, 6 4 879 

2.86 

.047 388 

.002 

246 

.0n6 917 

3.36 

-.085 719 

.007 348 

.0 16 3 951 

2.87 

.044 047 

.001 

940 

.0n5 778 

3.37 

— .086 686 

.007 514 

.OiftS 198 

2.88 

.040 687 

.001 

655 

.0 U 4 823 

3.38 

-.087 561 

.007 667 

.0 15 2 587 

2.89 

.037 309 

.001 

892 

.0n4 023 

3.39 

-.088 846 

.007 805 

•0,s2 091 

2.90 

.033 918 

.001 

150 

.0»S 354 

3.40 

— .089 038 

.007 928 

.0 1S 1 690 

2.91 

.030 517 

.000 981 

.0,i2 795 

3.41 

-.089 640 

.008 035 

.Onl 364 

2.92 

.027 110 

.000 

785 

.0 n 2 327 

3.42 

-.090 149 

.008 127 

.0 16 1 101 

2.93 

.028 699 

.000 

562 

■Onl 936 

3.43 

-.090 567 

.008 202 

.0n8 877 

2.94 

.020 288 

.000 

412 

.Onl 610 

3.44 

— .090 893 

.008 262 

.0 18 7 153 

2.95 

.016 880 

.000 

285 

.Onl 338 

3.45 

-.091 128 

.008 304 

.0, 8 5 761 

2.96 

.013 478 

.000 

182 

.0„1 111 

3.46 

-.091 272 

.008 381 

.0,«4 637 

2.97 

.010 086 

.000 

102 

.0,j9 225 

3.47 

-.091 325 

.008 340 

,0,63 730 

2.98 

.006 707 

.000 

045 

.0, 2 7 652 

3.48 

-.091 288 

.008 338 

.0,«2 998 

2.99 

.003 344 

.000 011 

.0i 2 6 344 

3.49 

-.091 161 

.008 310 

.0|«2 409 
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Table of sine x 9 sine 2 x, and exp (-ir* 2 ) ( cont’d) 


X 

sine 

X 

sine 5 

X 

exp (- 

irX*) 

X 

sine 

X 

sine 5 

X 

exp (- 

*x}) 


-.090 

946 

.008 

271 

.Oiel 

934 

3.75 

-.060 

021 

.003 

60S 

.0„6 

508 

3.SI 

— .090 

642 

.008 

216 

.o,„i 

551 

3.76 

— .057 

952 

.003 

358 

•0i»5 

140 

3.52 

-.090 

251 

.008 

145 

.0i*l 

244 

3.77 

-.055 

836 

.003 

118 

•0i#4 

057 

3.53 

-.089 

773 

.008 

059 

•0 n 9 

969 

3.78 

-.053 

677 

.002 

881 

•0u>3 

201 

3.54 

-.089 

209 

.007 

958 

•0i 7 7 

983 

3.79 

-.051 

476 

.002 

650 

•0i#2 

523 

3.55 

-.088 

561 

.007 

843 

.O176 

389 


-.049 

236 

.002 

424 

•O19I 

988 


-.087 

829 

.007 

714 

.0i 7 5 

110 

3.81 

-.046 

960 

.002 

205 

•O19I 

565 

3.57 

-.087 

015 

.007 

572 

.0 l7 4 

085 

3.82 

-.044 

649 

.001 

994 

•O19I 

232 

3.58 

-.086 

120 

.007 

417 

■0i 7 3 

263 

3.83 

-.042 

306 

.001 

790 

.Ojo 9 

685 

3.59 

-.085 

145 

.007 

250 

•0j 7 2 

605 

3.84 

-.039 

934 

.001 

59 5 

•0 20 7 

611 


-.084 

092 

.007 

071 

•0i 7 2 

078 

3.85 

-.037 

535 

.001 

409 

.0 7 o5 

978 

3.61 

-.082 

962 

.006 

883 

•0i 7 1 

657 

3.86 

-.035 

111 

.001 

233 

.0 2 q4 

692 

3.62 

-.081 

756 

.006 

684 

•0, 7 1 

320 

3.87 

-.032 

666 

.001 

067 

•0 20 3 

680 

3.63 

-.080 

477 

.006 

476 

•0i 7 l 

051 

3.88 

-.030 

200 

.000 

912 

.0:o2 

885 

3.64 

-.079 

125 

.006 

261 

-O188 

367 

3.89 

— .027 

718 

.000 

768 


260 

3.65 

-.077 

703 

.006 

038 

.O1&6 

654 


-.025 

221 

.000 

686 

-Osol 

769 


-.076 

212 

.005 

808 

•0is5 

289 

3.91 

-.022 

712 

.000 

516 

.O20I 

384 

3.67 

-.074 

655 

.005 

573 

.0 1S 4 

201 

3.92 

-.020 

194 

.000 

408 

•O20I 

083 

3.68 

-.073 

032 

.005 

334 

•OigS 

335 

3.93 

-.017 

668 

.000 

312 

•O218 

459 

3.69 

-.071 

346 

.005 

090 

•0i82 

646 

3.94 

-.015 

138 

.000 

229 

.O216 

606 


-.009 

599 

.004 

844 

•0«2 

097 

3.95 

— .012 

606 

.000 

159 

•0 2 i5 

156 

3.71 

-.067 

794 

.004 

596 

•0 18 1 

662 


-.010 

074 

.000 

101 

-0 2 i4 

022 

3.72 

-.065 

931 

.004 

347 

•0, 8 1 

316 

3.97 

-.007 

545 

.000 

057 

.0 21 S 

135 

3.73 

-.064 

013 

.004 

098 

•0, 8 1 

041 

3.98 

-.005 

022 

.000 

025 

•0 2 i2 

442 

3.74 

-.062 

042 

.003 

849 

.O198 

235 

3.99 

-.002 

506 

.000 

006 

•0 2 il 

901 


Half-peak abscissas 

sine 0 603355 = 0.5 

sine 2 0.442946 = 0.5 

exp [ -17(0.469719) 2 ] = 0.5 

sine 0.442946 = 1/V2 

exp [~j 7 ( 0 . 332141 ) 2 ]'l/vT 

sine' x - (cos 7 rx - sine x)/x 
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Solutions to Selected Problems 


CHAPTER 2: GROUNDWORK 

14. Since the real part of a complex quantity f(x) = R(x) + il(x ) can be obtained by adding 
the quantity to its complex conjugate and dividing by 2 , 

m = \/(x) + 

It is given that /*(x) = -f(-x). Hence 

R(*) = - \n-x). 

We see that R(x) is odd because R(x) + R(— x) is zero. For the imaginary part I(x) we 
find 


«'*(*) = \f{x) - \f*(x) 

= \m + \f(-x) 

which we see is even because 7(x) — I(— x) = 0. 

The Fourier transform of f(x) = R(x) + i/(x) has two parts. The transform of R(x) 
(which is real and odd) is imaginary by the previous problem. The transform of 7(x) 
(which is real and even) is real; therefore the transform of i'7(x) is imaginary and the 
whole of the transform is therefore imaginary. 

19. The expression of 2.18 will be satisfactory as a measure of degree of symmetry, pro¬ 
vided the integrals are evaluated over one period. For the first function mentioned, the 
even axes are at x = 0, ±1, ±2,, and the degree of symmetry is 100 percent. The 
degree of odd symmetry would be 100 percent for A(x) — 5 because that function be¬ 
comes odd if shifted half a unit of x. The function A(x) - | retains 100 percent even 
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symmetry but the odd symmetry is essentially destroyed, amounting only to 12.5 per¬ 
cent by the index. 

J_,[A(x) - i][A(x - 1) - \}dxj J*JA(x)] 2 dx 

= 2J’ (| - x)(-\ + x)dx/ J o ' (1 - x) 2 dx 

= 1 / 8 . 


22. If f(x) is even, then f(x) + F(x) transforms into itself. For example, where f(x) = l and 
F(s) = 6(s) then 1 + S(x) transforms into itself; another example is FI(x) + sine x, which 
transforms into sine x + n(s). More generally (/. Phys. A: Math. Gen., vol. 24, pp. 
L1143-1144,1991),/(x) + F(x) + /(-x) + F(-x) is self-transforming. This follows from 
the above because /(x) + /(—x) is an even function whose transform is F(s) + F(—s). 
The eigenfunctions of the Fourier transformation which are by definition self-trans¬ 
forming, are listed in Problem 8.25. 


CHAPTER 3: CONVOLUTION 


6. Let f — g * h. Then 

f*f = (g*h)*(g*h) 

= g*[h*(g*h)] 

= g*[h*{h*g)] 

= g*[(h*h)*g] 

= g * [g * ( h * *)] 

= (g*g)*(h*h), Q.E.D. 

f oo Too 

9. Theorem: f(g * h) dx = g(h ★ /) dx 

J —OO J — OO 


Derivation: 


[“ f(g*h)dx= J 

‘oo 1 

m 


oo 

?(«) h(x - u) du 

J -OO J 

J 

-oo 

f°° gi u ) 

J 

J 

—OO 

foo 

/(x) h(x - u) dx 

—OO 


= f £(“)[/ * *(-)] du 

= f°° g(h* f)du. 

J —OO 


A more symmetrical theorem, not involving f(g * h), but deducible from the foregoing 
by interchanging g and h, is 

f oo Too 

g(h * /) d x = h(g ★ /) dx. 

J — oo J —oo 


Comment: A relation involving the Fourier transforms is 
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(oc Too 

f(g*h)dx= F(-)GH ds. 

J -oc J -oo 

11. Let K^u) and K 2 (u) be two hermitian functions and let S(u) — K^u) + K 2 (u) and 
P(u) = Kj(u)K 2 (u). The sum S(u) is hermitian by definition if S(— u) = S*(w). We see that 

S(~u) = *,(-») + K 2 (-u) = K* (u) + K* («) = [JC £ («) + K 2 (m)]* 

= S*(u), 

so the sum is hermitian. Now 

P(-u) = KJ-uM-u) = K* ( u)K* 2 (u) = [K,{u)K 2 (u)]* 

= P*(u) 

and the product is also hermitian. 

17. Let x = 0.2 n where n is integral. Then the problem is first to find approximate values 
for /j(x) where 

{/,(«)} * {1.0 0.8187 0.6703 0.5488 0.4493 0.3679 ...} = {1}. 

By the method of Fig. 3.10 we find {/i(«)} = {1 —0.8187}. The normalized sequence 
asked for is {1 -0.8187}/0.1812 = {5.518 -4.518}. 

25. The desired function is given by the area of overlap of two unit-diameter circles whose 
centers are separated by r. If the centers are at C and C', Q is the midpoint of CC', P 
is a point of intersection of the two circles and R is the point nearest to C' on the cir¬ 
cle with center at C, the area is four times the segment PQR. 

chat r = 4(sector CPR — triangle CPQ) = 4^ CP 2 cos 1 r — ^ CQ ■ PQ 
— ^[cos -1 r — r(l — r 2 ) 1 ^}. 

29. (a) Each sequence is the reciprocal of the other as verified by taking the convolution 
sum. (b) Two functions whose samples agree with the two sequences are v(t) = 2 H(t) 
and i(f) = 2 cos irt H(t). 

30. Any sequence having period 2, 3, or 6 elements is invisible to convolution with the 6- 
element {a*}; consequently no periodic components of period 2, 3, or 6 will be present 
in the given {c*}. The deconvolution algorithm cannot recreate them; it will produce 
that part of the unknown {{4} from which the components of period 2, 3, and 6 have 
been removed—known as the principal solution ( Austral. }. Phys., vol. 7, pp. 615-640, 
1954). In some circumstances the unknown {£4} may nevertheless be recoverable, for 
example where {£4} has finite extent. This important subject comes under the heading 
of restoration. 

31. Time to convolve should not depend on which sequence is shorter. Asymptomatic vari¬ 
ation with N will depend on whether the convolution is computed by direct multipli¬ 
cation and adding, by the matrix multiplication method of Chapter 3, by multiplica¬ 
tion of transforms, or by a built-in routine. The interesting thing about timing is that 
the asymptotic variation for your chosen method can be determined empirically. 



516 


The Fourier Transform and Its Applications 


CHAPTER 4: NOTATION FOR SOME USEFUL FUNCTIONS 


7. 4 sine 4x * sin x 


-f 


oo sin (x - u) sin 4vx 


ITU 


du 


sin x f oo cos u sin 4ttu 


tt 




du — 


u 


cos x f°° sin u sin 47 tu 
47 T j -oo u 


du 


2 sin x [oo cos u sin 47 tu 


77 


f: 


u 


du — (null term due to odd integrand). 


We need the standard integral (e.g., see Gradshteyn and Ryzhik No. 3.741.2). 

f oo sin ax cos bx , , 

- dx = tt/2, a>b>0. 


Thus 


foo sin 4wu cos u 


Jo 


u 


du = tt/2 


and 4 sine 4x * sin x = sin x. 


12. We find that 


A'(x) 


' 0 

- 1 
-1 


1*1 > 1 

- 1<*<0 
0 < x<l 


and we see that this is equal to -Fl(*/2) sgn x. The second derivative, away from the 
points of discontinuity at * = —1, 0,1, is zero. In classical analysis we say that A'(x) is 
not differentiable at those points, or that the second derivative of A(*) does not exist 
at those points. However, in the next chapter such a situation will be handled by delta- 
symbol notation, as follows. 

A"(x) = S(x + 1) - 2S(x) + 8(x - 1). 




A'(x) 


- 


X 



15. By definition 



x > 0 
x < 0 


and, because |x| is continuous. 
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x > 0 
x < 0 


= sgn x. 

Now, sgn x is not continuous; therefore we cannot simply differentiate the expressions 
1 and —1 in the two ranges of x and conclude that (d/dx) sgn x is zero everywhere. The 
discontinuity of amount +2 at x — 0 will produce a result sgn' x = 28(x) in the nota¬ 
tion of the next chapter. The fact that |x| and 2xH(x) have the same second derivative 
is due to the fact that their first derivatives differ by a constant as may be seen by dif¬ 
ferentiating |x| — x = 2 xH(x). 


19. The result can be confirmed with a lengthy table of integrals or, equivalently, from a 
table of cosine transforms, both of which are available as software packages. Also the 
Pictorial Dictionary shows that jinc x D (1 — s 2 )TI(s/2). The desired infinite integral 
equals the value of the transform at s = 0, which is unity. 


CHAPTER 5: THE IMPULSE SYMBOL 

3. The expression 8(2x 2 - 5 ) is zero except where 2X 2 - \ = 0, i.e., at x = where there 

will be impulses. The strength of each impulse will be the reciprocal of the absolute 

slope of 2x 2 — which is 2 at both x = \ and x = Hence 5(2r 2 - |) = 
|8(x — 5 ) + 3 <5(x + 5 ). In the case of 5(x 2 — a 2 ) the absolute slope is 2a at x = a and 
x = -a. Hence ^(x 2 - a 2 ) = S(x - a)/2a + 8{x + a)/2n. 

7. (a) The roots of sin 7 tx are at x = 0, ± 1, ± 2, . . . and the absolute slope at the zero 

crossings is it. Therefore S(sin rrx) consists of impulses of strength 77- _I at integral 
values of x. Consequently ir8( sin vx) is the same as III(x). 

(fc) In the case of 8(sin x) the impulses are of unit strength situated at x = 0, ±7r, 
±27 t, . . . and the ensemble is represented by 7T' 1 III(x/7r). The tt in parentheses 
stretches the abscissa to make the impulse separation 77 instead of unity as for III(x). 
But the stretching strengthens the impulses; hence the compensating factor 7r 1 . 

9. A graph will show' that 

IH(X) n(x/8) = ^S(x + 4) + III(x) II(x/7)^5(x - 4) 

provided we take n(±j) to be This feature was not provided for in the definition of 
n(x). It arises here, not out of the definition of n(x), but out of the sifting integral when 
the sifting impulse falls at a discontinuity of the function being sampled. The result is 
(P- 76) 


[°° 8(x-«)/(x) = [/(fl+) + /(fl-)]/2. 

J —OO 


In our example we could write, for the right-hand edge of TI(x/8), 
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f 3 4 *8(x-4) n(x/8 )dx = \. 

Consequently 8(x - 4) n(x/8) is equivalent to j8(x - 4) and similarly for the left-hand 
edge where 8{x + 4) Il(x/8) = |S(x + 4). 

12 . (a) A satisfactory proof that 8'(-x) = ~8'(x) is as follows. The sequence p T (x) = 
t -1 exp(—7 tx 2 /t 2 ) defines S(x) and 

Too f 00 

j _ o<= 8(x) F(x) dx 4 Hm J jp,(x) F(x) dx = F(0) (1) 

in the notation of p. 92. The sequence p T (x) defines S'(x). Let us now establish that 

|“ co S'(x)F(x)dx=-F(0). (2) 

By definition 

f oo Too 

8'(x) F(x) dx = lim I p' T (x) F(x) dx 

J -00 t-K) 1 -oo 

= "1*38jl P-(*) F '(*) dx (p- 93 ) 

= -F'(0) from(l). 

Now for 8'(-x): 

f oo f OO 

«'(“*) F(x) dx = lim p’ T (~x) F(x) dx 

-oo T—k) J -oo 

= -lim j Pr{x) F( x ) dx (p’ T being odd) 

= HO). 

This discussion has provided an opportunity to exhibit the derivation of the basic 
relations (1) and (2) using generalized functions. But the argument can be summed 
up as follows. The generalized function 8'(- x) is the negative of 8'(x) because the 
sequence defining 5'(—x) is the negative of the one defining 8'(x). 

An interesting feature of the result is that there are sequences equivalent to 
p T (x) that are not even and sequences equivalent to p’ T (x) that are not odd. Never¬ 
theless 5(x) and S’(x) possess the properties of evenness and oddness respectively, 
in generalized function theory. For more on this see 5.19. 

In another approach we may regard 

«'(*)./(*) = £/(*) (3) 

as a basic property of 8'(x). It follows by reversing both sides that 

*'(*)*'<-*J-SR*-* 

Let g(x) = f(~x). Then 

S'(~x)*g(x) = 


(4) 
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Comparison of (3) and (4) shows that S'(—x) behaves like — S'(x). 

( b) To investigate xS'(x), multiply it by a test function F(x) and integrate. From (2) 

j ^ xS'(x) F{x) dx = -£ [xF(x)] r=0 

= -f(0). 


( OO 

But [-«(x)]F(x)dx = — F(0). Hence xS' = -5(x). 

J -oo 

(c) £ [f(x) 8{x)} = £ [/(0) 8(x)] = f(0) 8'{x). 

Also 

£[f(x)8(x)]=f(x)8'(x) + f(x)8(x) 

= f(x)8'(x) + f'(0)8(x). 

Hence /(x) 8'{x) = /(0) 8'{x) - /'(0) 8(x). 

All the foregoing discussions can be redone in terms of the sequence t~ 1 FI(x/t) 
and its derivative t _1 [5(x + r/2) - 8(x — r/2)] with a view to reinforcing intuitive feel¬ 
ing for the results. 

19. The "causal" sequence T _1 n[(x - |t)/t] (t > 0) is sometimes adopted in books deal¬ 
ing with the response of systems whose inputs switch on at t = 0. The impulse re¬ 
sponse is then the limit of the response to rectangular pulses as t —► 0. The sequence 
of rectangular functions defines an entity 5 + (x) with the property 

G(0+) - lim [°° T^nifx - \t)/t]G{x) dx = f“ 8Jx)G(x)dx 

T-»0 J -oo J -oo 

where G(0+) = UmG(x + |e|). 

A similar property holds for 8_(x). Since (p. 76) 

|^6(x) G(x) dx = \ G(0—) + \ G(0+), 
it follows that 6(x) = j6_(x) + §8 + (x). 

The asymmetrical profile r _l {A(x/r) + ^A[(x — t)/t]} contains two parts, the first 
behaving as S(x), the second as ^> + (x). It defines an entity 8 a (x) — 8(x) + \8 + (x) = 
$+(*) + jS_(x) (i.e., n = 1, v = |). 

In the theory of generalized functions many problems are circumvented by limit¬ 
ing attention to sequences and test functions that have derivatives of all orders. Since 
we are always applying impulse symbol notation to test functions G(x) that do not meet 
the requirements, subsidiary arguments are often required to establish that a standard 
result will remain true even though G(x) is defective. In addition, however, there are 
phenomena that arise in practice that are not in the theory of generalized functions at 
all. The notion of 8 + (x), which sifts out the value at the right-hand side of a disconti¬ 
nuity is one of these. 
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24. (a) When we take the limit of }t _1 A[(x/t) - 1] as t —►0 we must first fix x. If we fix x 

at 0, the function value is zero for all r and so the lim it is zero. If x # 0, the func¬ 
tion value rises to a peak and declines as r —> 0; for t < x/2 it remains zero and 
thus has a limit of zero. The function /(x,t) quoted has unit area but approaches 
zero for all x, in the limit as t —>0. (One might note that max[/(i,r)] increases with¬ 
out limit as r—>0.) Regular sequences (p. 90) also exist with the same properties. 
Nevertheless such sequences are equivalent to other sequences for <5(x). 

(b) An example where /(0 ,t)-+ -oo as r —>0 is furnished by t _1 [A(t -1 x — 2) — 
A(r _1 x) + A(r~’x + 2)], representing a negative central triangle function flanked 
by two equal positive ones, the whole having unit area. 

25. («) From Problem 5.12, /(x)S'(x) = /(0)S'(x) - /'(0)6(x). 

Differentiate to obtain /(x)6"(x) + f'(x)S'(x) = f(0)8"(x) - /'(O)fl'(x). 

Thus /(x)<5"(x) = /(0)<5"(x) - /'(0)S'(x) - /'(x)S'(x). Using 5.12 again to expand the 
third term we have 

f(x)8"(x) = f(0)8"(x) - 2/'(0)S'(x) + /"(0)S(x). 

( b) Prove this part by mathematical induction. If /(xj^^x) = 

a 0 /(0)8^(x) - ai f'(0)^~ l \x) + ... + «„/ (n) (0)5(x) (1) 

then 

/(x) & n ^\x) + f'(x)#”Xx) = acf(0)tf n+ 'Xx) - aj'(0)^ n \x) + ... + fl„/ w (0)<5'(x) 
and, transposing and using (1), 

/(x)# n + ,) (x) 

= <W(0)7S<" +1 >(x) - ai f'( 0^\x) + ...+ fl„/ (n) (0)fi'(x) 

- a o f'(0)$ n Xx) + ...+ « n _,/ w (0)S'(x) + a„f n+ '\0)8(x) 

= W)^ n + ,) (x) - WO^x) + ... + b„f n X0)8'(x) - b n+ S”"X 0)«(x). (2) 

We see that the sequence {fc u b-i ... b n } = {11} * {a 0 a j ... a„}. Now (1) is true for 
n = 2, with binomial coefficients (1 21}. Therefore (2) is true for n = 3, with bino¬ 
mial coefficients {13 31} and so for n = 4 and for all integral n. 

32. As the waveform should not matter let us select a rectangular pulse. We can also 
study the current 1(f). Thus P(t) = fcn(f/r) and since V(t) = R I(t ) it follows that 
7(f) = (K/R)n(f/r). It is given that 

jv(t)im = 2 . 

Now V(t)I(t) = (K 2 /R)Yl(t/r). Therefore 

{(K 2 /R)n(f/r)df = 2 

from which we find K 2 = 2R/t. Thus for the instantaneous power 

P(/)J(t) = 2r- 1 n(f/r) 

which tells us that the power is describable by an impulse 25(f) as t becomes too brief 
to worry about. However, if the voltage itself were a regular impulse, infinite energy 
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would be transferred to the resistor, contrary to what is given. Noting that 

V{t)I(t) = [V{t)] 2 /R = 2JCV 1 n (f/r) 

we obtain 

P(t) = 2 1/2 t _1/2 n(f/r). 

The desired 6-notation for V(t) is therefore 2 1/2 S 1/2 (t/r). Even though the voltage wave¬ 
form is a null function, it can deliver finite energy to a resistor. 


33. (a) 


f 00 f oo 

6 (x)6(y) dx dy 

J -oo J -oo 



r oo / 

OO 

- lim 


T 

T-.0 . 

1 -oo J 

—oo 


[rfl 

fr/2 

= lim 



r—>0 

J-t/2 

J-t/2 


-'n{x/TyT-'n{xt/T)dxdy 

t~ 2 dx dy = 1. 


Because of this property we write 5(x)6(y) = 2 S(x,y) as on p. 85. 

(b) A unit blade making an angle 0 with the x-axis is described by 8(y — x tan 8) and 
6 (y) is a unit blade along the x-axis. Thus the problem asks us to consider an inte¬ 
gral such as 


f oo Too 

/ = 6(y — x tan 0)8(y) dx dy. 

J —OO J —oo 


Following the rule. 



The integrand is t~ 2 over the parallelogram ABCD whose height is t, base r/sin 8 
and area r 2 /sin 8. Hence the value of the integral is 1/sin 8 and approaches infin¬ 
ity as the intersection becomes more and more skew. 


35 . 


|“_«(sin *)n(* - i)<fe = \ 
( 8(cos x) n(x/4) dx = 2 

J —OO 

[ 8(sin 2x)n(x/4) dx = 

J -OO 2 
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36. There is a strong objection from practitioners of the single-sided Laplace transform, 
which they can avoid by changing their notation to 8 ,(x) for explanatory purposes (see 
Problem 5.19). 

37. Because |x| is continuous its derivative, away from the origin of x, simply equals sgn(x). 
So the asserted equality is subject to the condition x * 0. At x = 0 the derivative will 
be an undetermined constant but it disappears on further differentiation. As |x| + x is 
identically equal to 2xH(x), both these functions have the same second derivative 2 8(x), 
even though both are undefined at the origin. 

38. Examine the normalized sum N _l 2^2 sin 2—As over the range 0 < s < 0.25 for larger 
and larger values of N, such as N = 200, 400, and 800. The graph will show, if it was 
not otherwise obvious, that 2*2 sin 2-jrks does not converge, but will also show that 
the partial sums oscillate evenly about the value j cos when s is chosen so that 
27rs = 1°. In problems where III(x) sgn x occurs as a factor in an expression that is phys¬ 
ically more realistic, adoption of the suggested transform can lead to a rigorously cor¬ 
rect result. 


CHAPTER 6: THE BASIC THEOREMS 

12. Let the notation /* 3/2 mean/convolved with itself half a time. From the previous prob¬ 
lem it would be reasonable to require that 

f*3 /2 D f3/2 

or 

13/2 


/* 3 /2 = | e ansx | e airsu f(u) du 


ds. 


This integral expression provides an operational definition for fractional-order self-con¬ 
volution. For a different view see Chapter 13. 


14. From Problem 6.1(d), 


Hence 


e ax * D ( 7 r/afe 


e axl * e~ bx2 D 7r (ab)-je"^" ,+rl l 


20. Let g(x) = | f(u) du. Then j G(s) ds = g(0). Consequently 

| 9^ j /(w) du dx = | f(u) du. 
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26. 


i sine 2 x cos ttx dx = 

) —oo J —o 


A(s) 


^5(s + §) + ~8(s - |) 


ds 



28. First verify that ( ttx ) 1 D —i sgn s, which is easily done by evaluating the Fourier in¬ 
tegral of the R.H.S. Then 

(7tx) _1 * (-7rx) -1 D (-! sgn s)(i sgn s) = sgn 2 s = 1. 

The function whose transform is 1 is 5(x). It follows that any function whose transform 
jumps between 1 and —1 will have an impulsive autocorrelation. Examples of such 
functions are 2 sine x - 8(x), 8(x) - 4 sine x cos a>x (co > 27r), and (ttx) 1 e“. 


29. The surprising result seems to say that 

e~ w = 8(x) + (47T)- 1 5"(x) + ..., (1) 

which cannot possibly be true. The flaw appears if we write the reasoning out in full 
as follows: 


N s « 

/(x) = lim V F ( ">(0) 

’ n^oc £ 0 nl 

N 

= jim 2 3 '[s"F ( " ) (0)/m!] 


n = 0 


= + s(N) ^iZ^ {x)dx 


( 2 ) 

(3) 


We know that the Fourier transform of a sum of a finite number of functions is the sum 
of the separate transforms, but is the transform of a limit of a sum (2) equal to the limit 
of the sum of the transforms (3)? Evidently not. The situation is analogous to a dou¬ 
bly infinite series that has to be summed over rows and columns. If we plan to obtain 
the row sums first, then sum those, the row sums themselves must exist. In the pre¬ 
sent case we move from (2), where the sum for each s does exist in the limit, to a re¬ 
arrangement (3), where Fourier integrals over s do not in the strict sense exist. Even 
so, the peculiar relation (1) may have some application. For example, if we had to find 
the transform of e n(s/a), which is not analytically convenient, would a correct se¬ 
ries result be furnished by 


« sine ax * [8(x) + (4rr) 1 8"(x) + ...]? 


33. Let (Exp) mean any function of the form a exp(-|x|). Then (Voigt) = (Gaussian) * 
(Cauchy) D (Gaussian) x (Exp). 

So (Voigt) * (Voigt) D (Gaussian) X (Gaussian) X (Exp) X (Exp) 

= (Gaussian) X (Exp). 

Hence (Voigt) * (Voigt) = (Voigt). 
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CHAPTER 7: OBTAINING TRANSFORMS 


1. The second derivative F"(s) is approximated by the second finite difference 
F(s + As) - 2F(s) + F(s - As) divided by (As) 2 . So F"(0) is approximated by 
[F(As) - 2F(0) + F(— As)]/( As) 2 . The imaginary part of F(s), being odd, has no curva¬ 
ture at s = 0 while the real part, being even, allows F(-As) to be replaced by F( As). 
Consequently, the expression -F"( 0)/4n 2 is approximated by 2[R(0) — R(1)]/47 t 2 (As) 2 , 
a quantity that should be a little less than the second moment of the data (the agree¬ 
ment improving as As is smaller). After F(0) has been verified as being equal to X/(x), 
the moment test checks that R(l) has no gross error. 

2. See tables of integrals under trigonometrical functions of complicated arguments, or 
tables of cosine transforms. A simple numerical check is to sum cos ttx 2 at interv als 
Ax, multiply by Ax, and compare with F(0) = 2 _1/2 . The summand becomes so highly 
oscillatory as x increases that numerical summing might seem unreliable. However, 
most of the contribution to the integral comes in the first few cycles around x = 0, the 
rapid oscillations at larger |x| tending to cancel. Thus the sum from x = 0 to 10 with 
Ax = 0.1 agrees with expectation within a few percent, immediately eliminating gross 
errors. Repeating for x = 0 to 100 with Ax = 0.001 gives agreement to 0.2 percent. While 
numerical approximation of this kind does not constitute a proof, it gives fast reas¬ 
surance against the factors of 2, tt, and so on, that tend to creep into algebra and cal¬ 
culus. 


3. It is already known that cos ttx 2 D 2 -1/2 (cos its 1 + sin its 2 ). The additional integral 
'/^xjSin 7rxV ' l7rsx dx equals 2 i / 0 °°sin rrx 2 cos 27 tsx dx (after omitting the infinite integral 
of sin 7rx 2 sin 2 irsx on the grounds that this integrand is an odd function of x). From 
tables of integrals or of cosine transforms we conclude that 

givx 2 -) 2“'/ 2 [cos its 2 + sin trs 2 + i(cos 7rs 2 - sin tts 2 )] 

= 2~ 1/2 [e~‘ w + ie _,w ] = Vie"' w . 

While tables are convenient, transforms can also be worked out by hand. Take this 
case as an example. Since neither cos x 2 nor sin x 2 dies out as x increases, introduce 
damping that will later be allowed to approach zero. Thus consider exp(-trx 2 )exp ix 2 , 
where <r will later approach zero. Then 



e ^ '^e ,2lr?t rfx 


— e -vVHa-i) 
_ e ~T V/V-i) 


_ e ~i — 0 




Finally 


^ D lim<l>(s) = 
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From this it follows that 

d Vie^ 

and, separating the real and imaginary parts, that 

cos 7 tx 1 D 2~ 1/2 (cos its 2 + sin 7rs 2 ) 
sin ttx 2 7) 2 _1 ^ 2 (cos tts 2 — sin tts 2 ). 

5. (a) Apply the similarity and shift theorems, (b) {/} = {0 l| 3 4| ... 10§ 12 ll| ... 
Is 1 5 0}- (0 Agreement is better than 0.25 percent of F(0) at the worst. 

6. The agreement with G(s) = 8e i9 ’ rs sine 8s + 4.58(s) is not very good. Suppose that in a 
similar case you were unable to obtain the theoretical transform so easily but that you 
could compute it. In preparation for such a day, experiment with ways of recomput¬ 
ing the present case so that the computed values are closer to the theoretical transform. 

7. The product has a limiting value of zero for all integer values of s up to N since there 
is one null factor for each such integer. For s « 1, the product approximates 
1 — s 2 - s 2 /4 — s 2 /9 — ... = 1 — s 2 (l + 1/4 + 1/9 + ...) = 1 — (7t 2 /6)s 2 , which is also 
approximated by the Gaussian exp( — tt > s 7 /6). Consequently computation will show 
agreement with Gaussian only for s values so small that the quadratic expansion for 
the exponential function is good enough. Such poor agreement is to be expected from 
the standard expansion 


OO 

sin 7TS — 7rsJZJ(l — s 2 /^ 2 ), 
t=l 

which shows that the limit of the original continued product is sine s, as mentioned in 
problem 8.32. 

8. Assign the weekly mean (1/7) to F 0 . The fundamental component, with a frequency 
of one cycle per week, will have both an amplitude and phase; assign these to Fj and 
F 2 . Assign F 3 and F 4 to the component with a frequency of two cycles per week, and 
the two numbers for the third harmonic, at three cycles per week, will complete the 
set of seven. 

This raises an interesting question. The highest frequency discernible from daily 
values is 0.5 cycles per day, or 3.5 cycles per week, and the amplitude and phase of 
this two-day periodicity would have been ascertainable from the long data set that was 
used to compile gj. However, the frequencies associated with the seven sufficient num¬ 
bers F k were at 0, 1/7,2/7, and 3/7; the highest of these does not reach 0.5 cycles per 
day. Thus information on a conceivably significant characteristic (day-to-day alterna¬ 
tion) has been lost. The loss mechanism is that data for alternate Mondays would be 
in antiphase, and so daily alternation is canceled out by the weekly summation. Such 
a variation would be discernible by summing over a fortnight to obtain a data set of 
14 values. Now, posing the original question in terms of the new F k ,k = 0 to 13, and 
assigning F 0 to the mean (1/14) 2F*, what would be the remaining 13 values of F k 
needed to fully represent the 14 data values? 
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CHAPTER 8: THE TWO DOMAINS 

1. We may convolve the two Gaussians as in Problem 6.14 or use the following reason¬ 
ing. Each of the Gaussians has area 7r l/2 ; therefore their convolution will have area tt 
because of the property 


f OO f 00 /oo 

(J*g)dx=\ f dx gdx. (1) 

J -oo J -oo J —oo 

(This is the property used for checking on convolution performed numerically (p. 32) 
and is derivable from the definite integral relation (p. 136), according to which both 
the left and right hand sides of (1) are equal to F(0) G(0).) Now since variance is addi¬ 
tive under convolution (p. 143) the variance of the desired convolution is double that 
of expj-r 2 ); therefore it is 2 ,/2 times wider; multiplication by 7r 1/2 /2 1/2 will bring the 
area to tt as required. Hence 

exp(-x 2 ) * exp(-x 2 ) D (tt/2) 1/2 exp(-x 2 /2). 

This type of reasoning is valuable (a) for cross-checking results because it is rather un¬ 
like integration and therefore not likely to be subject to the same kind of mistakes and 
( b) for obtaining partial results, such as widths alone, when peak values or areas may 
be fixed by other considerations. In the above discussion we are shooting for parame¬ 
ters; we already know that Gaussians convolve into Gaussians. 


6. The actual daily values are deducible and must be as follows, beginning January 1, 
1900: 


10,10,5,0,0,0,0,0,0,0,0,15,35,30,20,25,15,10,10,10,0,0,10,10,15,25,20,20,15,20,15. 


In general, inversion of running totals is subject to an uncertain term consisting 
of a strictly periodic variation with a period equal to the length of the totalling period, 
and with zero mean value. Very often there are external facts helping to determine the 
amplitude and form of such an additive term. In the present problem the key fact is 
that the numbers represent sunspots and therefore cannot be negative. Consequently, 
on any occasion when the five-day running total is zero, the five adjacent daily values 
must be zero, and in January 1900 this enabled a unique solution to be found. On other 
occasions, our prior knowledge that there is no five-day periodicity in sunspots could 
be used. For example, by guessing a few consecutive values we could arrive at a so¬ 
lution, then numerically filter out frequencies around integral multiples of one-fifth of 
a cycle per day. This would lead to a fine optimization problem, since the limited quan¬ 
tity of data prevents the achievement of indefinitely narrow filter bands. 


10. The definition proposed attempts to extend the applicability of the equivalent width 
in two ways. First, the integral of the spectrum F(s) is replaced by the integral of the 
power spectrum F(s)F*(s) which will eliminate the cancellation that otherwise occurs 
if F(s) is in antiphase with F(0) at some values of s. Then, to allow for the possibility 
that the spectrum may peak up about a value other than s = 0, normalization is made 
to depend upon F max . However, the definition does not have the dimensions of band¬ 
width which should have the same units as s, and this will cause trouble. For exam- 
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pie, if a given F(s) is amplified by a factor 2 at each value of s, which would not 
ordinarily be considered a band-width change, the quantity proposed increases by a 
factor 2. 

13. (a) Let g(x) be a shuffled form of f(x). Then / g(x) dx = / f(x) dx and / gg*dx = / ff*dx. 
Hence, referring to the definition, 

W/./*= S fdx l f * dx /\ ff * dx = ^W- 

(fr) The equivalent width of g(x) is, however, sensitive to #(0). So 

W* = J Z dx /Z(°) = \ f dx /giO) 

which is equal to Wf only if /(0) = g(0). 

(c) The total energy of a waveform is J / ff*dx, which is unchanged by shuffling. Hence 
|F(s)| 2 at s = 0 is an invariant. Also is constant because = [W^] -1 . Like¬ 
wise /|F| 2 ds is constant. 

15. If f(x) = e~ x H(x) then the symmetrized function is g(x) — e _2|x| . Hence e~ |x| is the same 
as the symmetrized function but with abscissas expanded by a factor 2. From this re¬ 
lationship we find that the power spectrum of e~ M has twice the area (twice the wave¬ 
form energy), half the equivalent width, and four times the central value. 

18. By the modulation theorem 

e~ w * t cos (OX D -er*+**f + - 
2 2 

This transform consists of two humps of unit equivalent width and if co » 1, the 
humps will be widely separated. The transform of the desired autocorrelation function 
will be the square of the transform above and will also consist of two humps: 

1 1 

_g-27T(s + w/2ir)? _|_-—271^5 — (o/2lrf 

4 4 

plus a cross-product term which is small. Inverting the transform we find the auto¬ 
correlation function to be 

2 3/2 e cos cox. 


26. Consider a pressure variation 

0.01 W? cos(2500 e> /5 ) Nm' 2 , 

where T is say 10 s. It represents a tone that waxes and wanes in intensity and rises 
through one octave each 3.5 s. If this tone is repeated indefinitely at interv als of 3.5 s 
then at any given moment there will be several frequencies present going up by fac¬ 
tors of 2. The impression will be of a complex note with harmonics, and as time elapses 
the pitch of the note will appear to rise. As each harmonic in turn rises out of audibil¬ 
ity a subharmonic enters quietly from below, to gain in strength and to carry for a time 
the continuing impression of rising pitch. 
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29. Since g(x) = /(x) * n(x) 

= /(*) * [ n(» -1) + n(r -1) + n(* -1) + ] 

= /(*) * H(x). 

Differentiating, 

4 x "2j + ^v"iJ + " =/w 

[«(* - 0 + S'(x - f) + ...] • g(x) = f{x). 

Hence n~\x) = S'(x - + d{x - |) + 5'(x - |) + .... 

We can verify directly that 

n(x)*[s'(x-^) + S'(x-f) + ... = fi(x). (1) 

Since (sine s) _1 G(s) = F(s) where sine s ^ 0, it might seem that Il' 1 (x) D (sine s) -1 . 
However, we cannot divide by sine s where sine s = 0, so we cannot know F(s) at 
s = ± 1, ± 2,... and for a good reason. Any Fourier component of /(x) having an in¬ 
tegral number of periods fitting into the width of the rectangle function is suppressed, 
is absent from the given function g(x), and therefore cannot be restored. When 
FI -1 (x) * g(x) has been calculated it is subject to a periodic additive term of unit period 
and arbitrary shape and magnitude signaling irreversibility, in much the same way as 
an arbitrary integration constant does. 

This characteristic irreversibility shows up in the s domain derivation at the point 
where division by zero alerts us. The x-domain argument conceals a subtle point. 
Rewriting (1) for a finite number of terms we get 

n«. [4 -+ 4 - D ♦... ♦ 4 - ?)] = * w - - 1 - 0 

As n —> oo it would seem that the negative impulse would move out to the right beyond 
our ken, for all x. But, if we convolve both sides with some operand before letting n —> oo 
we may not get the same answer as convolving directly with S(x). The exceptions will 
be sinusoids of period 1,1/2,1/3,... which will be wiped out by the negative impulse. 

In many cases the parameters of any periodic component can be determined from 
a priori information. For example, if a function /(x) has stretches where it is zero, as at 
the beginning and end of finite-duration signals, any periodic component, which by de¬ 
finition never dies out, must have zero amplitude. The above discussion does not deal 
with restoration of deterministic signals in the presence of errors (Proc. I.R.E., vol. 46, 
pp. 106-111, 1958), which in practice dominate what may be done. 

32. We see that (1 - x 2 )(l - x z /4)(l - x 2 /9) = 1 - (1 + 1/4 + 1/9JX 2 + 

(1/4 + 1/9 + l/36)x* - x 736 = 1 - 1.3611 x 2 + 0.0274 x 4 - 0.027 x 6 , (1) 

whereas 

sine x = 1 - 1.6449 x 2 + 0.8117 x 4 - 0.1908 x 6 +_ 

The coefficient of X 2 determines the central curvature (and the second moment of 
the Fourier transform), and the correct value is -7r 2 /6. In the infinite-product formula. 
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each successive factor increases the central curvature; consequently, no finite number 
of factors gives the correct coefficient. We may however note that the series 2 , which 
appears as the coefficient of x 2 in (1), has a sum to infinity of 7^/6. In connection with 
the central limit theorem (p. 168) it was found that the product of many parabolic curves 
of the form 1 - ms 2 , not necessarily all with the same value of m, would approach a 
Gaussian function under certain conditions. Here we find a sine function instead. 


34. The desired variance is given by 


a 2 = 


[ i?e i ' 7rx/w '? cos lirvxdx 

J —no _ 

( e~^ x/w ^ cos 2irvxdx 

J -oo 


To avoid the integrations, work in terms of the Fourier transform F(s) of the wavepackel 

F"(0) 

4tt 2 F(0)' 

From the modulation theorem 


/(x). Then 


F(s) = lWe“ 7rfvv(s + , ' ) f + 

and F(0) = We _,TVVV . Note from a sketch of F(s), which takes the form of two Gaussian 
humps of width 1/W centered at s = ± v (see Pictorial Dictionary), that the second de¬ 
rivative at the origin, F"(0), is twice the second derivative of exp(- ttW 2 s 2 ) at s = v. So 

F"(0) = W(4tt 2 W 2 s 2 - 2ir)e~ nWV \ s „ v = W(4ttv z - 27r>T ,rWV . 


Hence, 


<r 2 = - 


W(4tt 2 WV - 27r)e“ ,rWV 


4TT 2 We~ nWV 


= — - wv. 

2ir 


If Wv > l/y/li t is a 2 negative? Yes. When W = v = 1; then a 2 = -0.841. 


35. Begin by looking for a simple way to construct the function. 

(a) Note that g'(x) is expressible as a sum of four rectangle functions 

n[(x + b)/c] - n[(x - b)/c] - (a- 1 - l)n[(x + \a)/a\, 
where b = (1 + a)/2 and c = 1 - a. The transform of this, equal to z2irsF(s), gives 
F(s) - (c sine cs sin 2-n bs — (1 - a) sine as sin Tras)/irs. 

(b) The second derivative #"(*) — 6(x + 4) + 8(x — 4) — (a -1 — l)[6(x + 1) + 
«5(x - 1)] + 4(a -1 - l)S(x). Therefore 

F(s) = [2 cos 2tt4s - 2 (a -1 - l)cos 27rs + 4 (a -1 — 1)]/(-4tt 2 s 2 ). 

(c) Subtracting (1 - a)A(x/a) from the trapezoid (1 - a)fl[(x/(l + a)] * n[x/(l - a)]/ 
(1 — a) offers another construction, from which 

F(s) = (1 - a)(l + a) sinc[(l + a)s] X sinc[(l - a)s] — a(l - a) sine 2 as. 

(d) Noting that /(x) is the difference of two triangle functions, /(x) = A(x) - A(x/a), 
gives 
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F(s) = sine 2 s - a sine 2 as. 

This last is obviously the preferred answer. It is striking how different the various ver¬ 
sions look, even though they are all equal. But they are not equal as regards the amount 
of work required to derive and verify. The moral is to begin by spending time imag¬ 
ining different approaches. 


36. (a) The length would be such that the round-trip travel time on the line is A = 0.1 fis, 
i.e., 15 m. (fc) The input impedance Z to a transmission line of length L, open-circuited 
at the far end, is 


Z = Z 0 coth 


V(7 + i(ol)(g + ia>c)L 


and the usual approximation for a loss-free line (r = g = 0) in terms of the inductance 
l and capacitance c per unit length is 


Z = -i'Z 0 cot 2u)T, 

where T = 2vL and v = 1/Vic is the wave velocity on the line (close to the speed of 
light). The corresponding voltage transfer function is -i cot 2wT. (c) The impulse re¬ 
sponse is 7(f) = 75(f) + 2£(t — A) + 2S(f — 2A) + .... 

The transfer function of an open-circuited length of transmission line is the Fourier 
transform of 7(f). Since 7(f) is not an odd function of f, the transfer function cannot be 
pure imaginary but must have a real part. This seems to imply that a loss-free circuit 
can dissipate power, but in reality an electric circuit always dissipates some power. (See 
Electronics Letters, vol. 34, pp. 1927-1928, 1998.) 


37. In Fig. 8.16 the second curve can be written in terms of E(x) — exp(—x)H(x) as 
~[E(x + 5) - E(x - 5)], which is a finite difference. 

The first curve cannot be expressed in this way as a finite difference of a single 
hump taken over a long interval. However, the curve possesses a finite sum in terms 
of which it is therefore expressible as a finite difference. A finite sum s(x) of a function 
/(x) is /(x) *{1111...} = f(x) + f(x - a) + f(x -2a) + f(x — 3«) + .... The finite 
difference of s(x) over the same interval a, yields the original /(x). Finite summing and 
finite differencing are thus reciprocal operations, analogous to integration and differ¬ 
entiation. Sequential application of the two operators {1111...} and {1 1} * yields 
the identity operator. Thus {1 11 1...} * {1 -1} = {1}. 

The third example can be expressed as the derivative of the function with four 
steps that is the integral of the given set of four impulses, but cannot be expressed as 
a finite difference. 


CHAPTER 9: WAVEFORMS, SPECTRA, FILTERS, AND LINEARITY 

11. (a) Consider the history of the input for the whole day, and the corresponding output. 
If we began again tomorrow with an identical box and the same day's worth of in¬ 
put the whole output would be the same, delayed by one day. Therefore the sys¬ 
tem is time-invariant. Jones did not take account of the fact that the state of the sys¬ 
tem was different in the afternoon, possibly because someone else used it at 
lunchtime and applied a step voltage. 
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(b) The system is nonlinear. Understand that the gate switch Iras to be open before the 
second input V 2 {t) is applied, so that all tests are performed on the same initial state 
of the system, and opened again, if necessary, before applying the sum V,(f) + V 2 (f) 
of the two separate inputs whose superposition is to be tested. 

12. The system is time-invariant, by the definition of time-invariance. We can see that su¬ 
perposition breaks down because the compressive force is proportional to the charge 
on each plate and therefore to the square of the voltage. Doubling the voltage will not 
therefore merely double the response, but will produce something different. Therefore 
the system is nonlinear. 

26. The relation follows from the derivative theorem in reverse, namely -i2Trxf(x) D F'(s). 

27. («) The function y(x) is strictly periodic, with period 2tt, or frequency \ir, as can be 
seen by eye from the plot, (b) The Fourier transform Y(s) has four spikes, at s = ±\rr 
and ± \tt. This follows from addition of the transforms 4.5fi(s ± | v) and 5.5S(s ± f7r). 
The transform Y(s) does not contain a component at the frequency \tt. We conclude 
that periodicities may be apparent to the eye that are not detectable by Fourier analy¬ 
sis. This phenomenon is particularly striking in two- and three-dimensional crystal 
structures. 

28. The transform of the sum of two functions equals the sum of the transforms, and there¬ 
fore no linear combination of the two functions can contain any frequency that is not 
present in either of the original functions. The present problem, however, is nonlinear 
because the two component functions y,(x) and y 2 (x) do not simply add; the final print¬ 
ing is given by y[x) = H[y,(x) + y 2 (x)]. Where one black line overprints another the 
result is black; the resulting value of y(x) is 1, not 2. In this case, Fourier analysis will 
reveal the visible periodicity. 

29. (a) L crll = W/V27T - 0.79788W. The minimum disappears where the second derivative 

of exp(-7rx 2 /W 2 ) is zero. 



Fig. 9.29 Fairs of equal Ciaussians, of equivalent width W and symmetri¬ 
cally placed at ±|L as indicated by ticks, are summed. The cen¬ 
tral curvature of the composite profile changes sign when 
I. = her" = 0.8W (heavy ticks and curve). The spectrograph record 
for lines spaced by L crit shows a flat top with no central mini¬ 
mum. The adjacent curves, above and below the flat topped 
curve, are for 0.8^, and 1.2L c „ t respectively, while the outlying 
curve is for 2L mt . 

( b) The single peak resulting when two "unresolved" lines coalesce is not Gaussian in 
shape; the separation and amplitudes of the two components can be extracted in 


532 


The Fourier Transform and Its Applications 


principle. But in practice, where the observed profile is the sole source of informa¬ 
tion, who would assure the observer that the "true" distribution consisted of just 
two equal-strength lines? To know that is to have foreknowledge of the unknown. 
As an alternative, the observer might postulate the existence of a small number of 
lines with arbitrary positions and strengths and show that an unequal line pair was 
compatible with observation within the errors, and use the conclusion in the de¬ 
sign of a further observation. In the presence of instrumental or external errors, one 
could establish the resolvable separation of an equal line pair as a function of er¬ 
ror level, assuming plausible error statistics. No doubt it would be hard to improve 
much over L cnt . 

Finally, another given of the original problem as worded was the assertion that 
the instrumental profile was known. That is sometimes effectively the case in prac¬ 
tice where an instrument can be tested with a single strong narrow line, but even 
then the instrumental response is fundamentally a measured profile subject to its 
own errors; could one ever assume that an instrumental response was Gaussian 
out to more than two or three equivalent widths from line center? 

30. (a) V(0) = 0 
V(l) = 0.5 
V(2) = e' 1 + 0.8 
V(3) = e~ 2 + 1.6e 1 + 1 
P(4) = e~ 3 + 1.6e~ 2 + 2c’ 1 + 0.3 
V(5) = e' 4 + 1.6e -3 + 2e' 2 + 0.6c' 1 
V(6) = e~ 5 + 1.6e' 4 + 2e' 3 + 0.6c' 2 

(I b ) The coefficients are exactly the same as the values of V 2 (t) at integer values of time, 
as expected from the fact that digital signal theory is included within continuous¬ 
time theory as supplemented by delta notation. 


CHAPTER 10: SAMPLING AND SERIES 

6. The integral of |sF(s)| over a limited band may differ seriously from the infinite inte¬ 
gral, because of the factor s, even though the fraction of power /x beyond the band lim¬ 
its is small. The corresponding view in the x-domain is that a small amplitude sinu¬ 
soid, added to a band-limited function, can seriously affect the net slope if the frequency 
of the sinusoid is high. 

17. (a) A filter containing only a finite number of inductors, capacitors and resistors has a 
finite number of natural modes and its natural behavior is therefore specified by a 
finite number of constants. 

(b) It will be evident when sufficient coefficients for use in Y, = ajY,., + a 2 Y,_ 2 + • • • 
+ /3X, have been determined because the right hand side will then correctly pre¬ 
dict the output Yj. 

35. function [y]«binam(n) 

b=([l 1J); y-1; count«l; 
while count < n+1 

y-conv(y,b)t count-count+1; 
end 
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36. Yes. So we see that Mountararat's lofty desire for simplification has suppressed the fac¬ 
tor 1/L in one place only to have it rebound in two places in the transform domain. 
The transform of the string of unit impulses spaced L is III(Ls), as obtainable directly 

\ from the similarity theorem. It seems a retrograde step to adopt notation that makes a 
fundamental theorem inapplicable, while at the same time not saving any ink. 

37. The sample values of the spectrum S(f) suffice to obtain other values by interpolation. 
For example, if the samples straddle / = 0 symmetrically, one can get S(0) from 

s(o) = o. 63 sQt - 1 ^ - + ... + o. 63 S^-^r -1 ^ - o.21s^-i|t4- — 

The coefficients applied to the samples in this case are those for midpoint interpola¬ 
tion. 


38. The sum of the series must be even and also periodic with period 2v. Outside the range 
0 s x s ir, the sum of the series must be j7r|sin x|. The fundamental period is thus tt. 
The coefficients are found by integrating \tt sin x cos 2tttix from 0 to 27 t. 


39. The summation has its poles coinciding with those of cot x, and, if the proposed iden¬ 
tity is correct, the zeros would fall at ± 7 t/2, ± 3-7t/2, ± 5^/2, .... Examine 
^“^(x — far) -1 to see if it is zero at x = rr/2. The series to be checked is 


OO 


2 - 


“OO 


1 

tt/2 — far 


- y_ \ _ 

7T 1 — 2k 


2 


7T 


1 




If the terms are selectively paired the sum can be made zero, but can be made to have 
other values too; for this reason the series cannot be claimed to converge. 

The selective pairing of (x — far) -1 with (x + far) -1 can be made explicit by sum¬ 
ming each pair to obtain 2x/(x 2 — Pit 2 ). The resulting formula 


1 °° 

cot x = - + 2 x 2 

x it=i 


1 

x 2 -* 2 ^ 


is then correct for all x except those values where cot x has a pole. The impeccability 
of this expansion results from forcing the sequence of summing. 

One expects problems arising from the fact that cot x has an infinite number of 
infinite discontinuities. If these are removed by convolution with e -1 exp(-7rx 2 /e 2 ), 
where e is a very small positive number, the resulting smoothed function can be made 
as indistinguishable from cot x as we please. Consequently the proposed identity has 
some virtue; thus, it can be used with the convolution theorem to produce such cor¬ 
rect results as 

g-ig-ir* 2 /* 2 * cot x ^ e -7r, VlII(s)sgn s 

The trouble is this. Convolving x -1 with a string of unit impulses spaced by it en¬ 
tails adding samples of a function x -1 that has area ±oo under its tails. If equal and 
opposite samples are neutralized by preaddition then a finite sum for the convolution 
results; but die teaching of our mathematical forbears is that, with infinite sums, 
bundling the terms can lead to discordant results. There is no unique sum. 
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40. The graph will show, if it was not otherwise obvious, that X v sin k does not converge, 
but will also show that the partial sums oscillate evenly about the value f cot |°. 

Replication of 1 /x at intervals tt, the operation supposed to add up to cot x, may 
be expressed by x 1 * 7r _1 III(x/7r), whose FT is (—iV sgn s)III(7rs), which back trans¬ 
forms into 2i°2 sin 2kx. Thus a consequence of the supposed representation of cot x 
by superposed 1/x functions would be that cot x — X/2 sin kx. 

As in the preceding problem, incorporation of the suggested transform as a 
factor in an expression that is physically more realistic can lead to a rigorously correct 
result. 


CHAPTER 11: THE DISCRETE FOURIER TRANSFORM AND THE FFT 

Solutions to Exercises a to e appearing in the body of Chapter 11 are presented first and 
are followed by solutions to the numbered problems. 

(a) We find that f ft ([4 2 1 0 0 0 1 2]) yields 

{10 6.8284 2 1.1716 2 1.1716 2 6.8284}, 

which is purely real, as stated. 

(b) The eight samples of Aft/A) for t — —3, -2, ..., 3, 4 are 

{1 2 3 4 3 2 1} 

- 2-101 2 34 

6 7 8 

where the small numbers immediately below the samples are indices n that are allowed 
to go negative, just as t does. Apply the rule for replacing - n by 8 - n to obtain the 
positive indices 6, 7, 8 in the second row of small numbers. The representation of the 
even function A(f/3.5) using positive indices is then seen to be {4 3 2 1 0 1 2 3}. In 
general, for an N-element sequence, the replacement rule is 

x(-rt)=*x{N - tt), 

for those values of n such that H N - « s N. 

(c) Consider an even function /(f) for which /((]) — 0,/(±l) = l,/(±2) = 2,/(±3) = 3 
and /(±4) = 4. By the replacement rule, the corresponding 9-element sequence, 
indexed starting with n = 1, is {/(l) /(2) /(3) /(4) /(-2) /(-1) /(0)} = 
{1 2 3 4 4 3 2 1 0}. More than one function of a continuous variable possesses this 
set of samples. The simplest example in this case is /(f) = 4.5{n(f - })/9] - A(f/4.5)} 
whose Fourier transform is 40.5 sine 9s — 20.25 sine 2 4.5s. As a further exercise one 
could plot the real and imaginary parts of this Fourier transform and compare with 
what fft ( ) gives for the sample sequence. 

fd) The given sequence represents a sample set of A(f/4) sgn f at unit intervals of f. Ap¬ 
plying fft( ) produces {0 -9.6569/ -4/ -1.6569/ 0 1.6569/ 4 9.6569/}, 
which is purely imaginary as expected. The presence of the additional term sin irt 
would not change the sample values at the integer locations. 

(e) The three discrete transforms are 
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X 4 (fc) = {4 0 0 0}. 

X s (k) = {4 1 - 2.4142i 0 1 - 0.4142/ 0 1 + 0.4142/ 0 1 + 2.4142/}. 

X 16 (Jt) = {4 3.0137 - 2.0137/ 1 - 2.4142/ -0.2483 - 1.2483/ 0 0.8341 + 0.1659/ 

1 - 0.4142/ 0.4005 - 0.5995/ 0 0.4005 + 0.5995/ 1 + 0.4142/ 

0.8341 - 0.1659/ 0 -0.2483 + 1.2483/ 1 + 2.4142/ 3.0137 + 2.0137/}. 

For comparison, ReF(s) = 4 cos 57 t sine 4s and ImF(s) = -4 sin 57rs sine 4s. 

10. The transform V(f) = 4(1 + /8ir/) _1 is illustrated by its real and imaginary parts. It 
will be noticed that the imaginary part dies out much less rapidly than the real part. 
(That is because the odd part of v(t) is discontinuous.) The real and imaginary parts of 
F(v) and the DFT are also shown. The two real parts agree very well in the range 
0 ^ ^ 0.5 corresponding to 0 r =£ 16. However, in the vicinity of / — 0.5 the agree¬ 

ment is not good as regards the imaginary parts. 





This can be understood in terms of aliasing that would arise in the imaginary part of 
V(f) if one were to take samples at one-second intervals. Because Im V(J) has not died 
out by / = 0.5 Hz, one-second sampling would be inadequate. Inclusion of the repli¬ 
cated island Im V(f - 1), shown dotted, accounts for the main discrepancy between 
FT and DFT around / = 0.5, in this case. In general, more distant islands V(J - rt) may 
contribute noticeably also. 
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13. (a) The discrete Hartley M-file is 

function y=dht (f,N) 

% Discrete Hartley transform of N-element real vector f 
F-fft(f); 

y= (real(F)-imag(F))/N; 

( b ) Applying the command dht twice in succession produces the original vector as 
expected except that it is eight times too small. To remedy this, omit the division 
by N. For the inverse operation idht the M-file is 

function ysidht(f,N) 

% inverse discrete Hartley transform of N-element real vector f 
F=fft(f); 

y«{real(F)-imag(F)); 

14. (a) Taking the central element 5 to correspond to x = 0, we see that the given elements 

are values of 5(1 — |x|/5) for x — 0, ± 1, ±2,-But the nine elements do not con¬ 

stitute the full infinite range of samples, (b) The index v corresponds to frequency 
v/N in cycles per unit of x, where in this example N = 20 elements. Thus the first 
null at v = 4 corresponds to frequency 4/20, in agreement with that expected from 
s = 1/5. Agreement between DFT and FT is perhaps reasonable; but at 
v — 6, s = 0.03, where the maximum of the first sidelobe of sine 2 occurs with a value 
25 x 0.045032 = 1.1258, the DFT gives 1.5279. This is because of the overlap of re¬ 
peats such as the one seen peaking at v = 20. These overlaps can be pushed fur¬ 
ther away by insertion of more zero samples. 


V 

0 

1 

2 

3 

4 

5 

6 

20 

20 X DFT 

25 

20.43 

10.47 

2.43 

0 

1.00 

1.53 

20.43 

s 

0 

1/20 

2/20 

3/20 

4/20 

5/20 

6/20 

1 

25 sine 2 5s 

25 

20.26 

10.13 

2.25 

0 

0.81 

1.13 

... 20.43 


15. The sequence {14 641} matches f(x) = (16/V2ir)exp(— 5 X 2 ) as to both r.m.s. width 
and area. The transform F(s) = 16 exp(-27rs 2 ) gives values in rough agreement with 
the DFT as follows: 


V 

0 

1 

2 

3 

... 8 

... 15 

16 

16 X DFT 

16 

14.80 

11.66 

7.65 

... 0 

• .. 14.80 

16 

s 

0 

1/16 

2/16 

3/16 

... 8/16 

... 15/16 

1 

16 exp(-27 t 2 s 2 ) 

16 

14.81 

11.75 

7.99 

... 0.115 

... 5/10 7 

4/10 8 


One sees that if the FT is to be obtained by taking the DFT of samples then accu¬ 
racy is a major concern. Values of the DFT can be compared graphically with 
6 + 8 cos 27rs + 2 cos 2ir2s, the transform of 8(x + 2) + 46(x + 1) + 6S(x) + 
48(* - 1) + S(x — 2), to see the effects of replication. 

16. The ordinary convolution sum is 

{112 65 208 429 572 429 0 -429 -572 - 429 -208 - 65 -12 -1} 
with the cyclic convolution sum is 

(-64 0 64 208 429 572 429 0 -429 -572 -429 -208}. 



chapter 21: Solutions to Selected Problems, Chapter 12 


537 


18. (fl) A MATLAB program is 


f = [14641]; 

F = fft(f ); 

0 = zeros(1,10); 

G(l,3) = F(l:3); 

G(9:10) = F(4:5); 
h * if£t(G)*2 

(b) Multiply the result by 2 to compensate for the change from 10 values to 5. 

(c) Change line 3 to G = zeros (1:30) and change line 5 to G( 29:30) = F(4:5) 

( d ) The MATLAB interpolates, for comparison, are 

{.1273 0 .2970 0 .5516 1 2.4190 4 5.4323 6 5.4323 4 2.4190 1 .5516 0 .2970 0 .1273} 


B 

CHAPTER 12: THE HARTLEY TRANSFORM 

10 . (fl) {0 0 0 0-2 0 0 0 } 

There is no d.c. value; the only frequency present is 0.5; consequently the only con¬ 
tent of the DHT is at v/N — 0.5, or v = 4. 

(b) The power spectrum is {00004000}. Since there Ls no content at v = 1 and 7, 2 
and 6 , 3 and 5, all the power spectrum values are zero except at v = 4. 

11. The Fourier series r = r 0 + 1a„ cos nd can represent a square as closely as wished if 
enough terms are used. The cas function formula is not only a simple exact equation 
for a square but it is in a directly computable form. Using (f mod ± \tt is also inter¬ 
esting. 

12. In the case of the Fourier transform, ?P?Ff(x) ~ f(—x) and the function is reversed, so 
four transformations are required to return to the original f(x). The cyclicity of the 
Hartley transform is already known from the reciprocal property of this transform. 

20. Although the infinite integral of 8'(t) is zero, the integral from zero to infinity is not, 
nor is the integral from minus infinity to infinity of the absolute value. Consequently 
the derivative of a delta function is not a null function. Nor would we want it to be. 
If you hit a golf ball of mass m with a force A6'(0 y ou would give a velocity (A/m)S(f) 
and produce a displacement {A/m) for t > 0, whereas if you hit something massive 
with a null function it does nothing. 

21. The impulse is located to the ENE. The period of the cas function transform is 
(a 2 + b 2 )'* = 2d. Thus a = cos 22.5°/2 d and b = sin 22.5°/2d. 

22. Let F rea i = x and F imag = y. In the coordinate system {x‘,y') which is rotated through 6 
relative to (x,y), 

x’ = x cos 0 + y sin f) 
y' — y cos 6 - x sin 6. 

When 6 = - 7 r/ 4 , 
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V2x' = x - y = f rMl - F imag = fi(v) 

V2y' = y + X = F imag + F rea] = 

Thus H(v) + iH(-v) is derivable from F real + »F imag by rotating through —it/ 4 and mag¬ 
nification by V2. 

23. From the formula for the tangent of a sum we have 

tan(<£ + rr/4) = [ tan(7r/4) + tan </>]/[ 1 — tan(7r/4) tan <f>\ 

— (1 + tan <£)/(l — tan 4>) 

= (1 + F imag /F rw i)/(1 - F imag /F real ) 

(f"real h f’imag)/(f’real f’imag) 

= H{-v)/H{v). 

24. Put a = cos 0,b = — sin 8 , c = 0, d — sin 8 , e = cos 8 , f = 0. 

26. The value of n F(0) should equal the mean of the data values divided by V2. For the 
inverse DCT2 there is nothing comparable in simplicity. The relation is 
/(0) = 2~ 1/21 i F(0) + "F(1)cos(tt/2N) + u F(2)cos(2tt/ 2N) + n F(3)cos(3rr/2N) + .... 

For DCT1 the leading value is N' 1/2 [/(0)/V2 + /(1) + /(2) + 
... + f(N - 1) + /(N)/ V2], and, since DCT1 is symmetrical, the value of /(0) can be 
checked similarly. 


CHAPTER 13: RELATIVES OE THE EOUR1ER TRANSFORM 


42. Convert to the Fourier transform of the even function /(|x|) and evaluate 
/!^/(|x|)cos 27 rsxdx. Since /( |x|) = §n(x) + |(1 - 4 jc 2 )FI(x) we can use the known 
transform of a rectangular function plus a parabolic pulse to find 


. 1 . 1 . . 

F,(s) = — sine s -l—r^sme s - cos ns). 
2 n*s* 


Check by noting that F f (0) = 5/6, which equals the area under f(\x\). 


43. Since you do not know the purpose of the processing it might be effective, in getting 
the job, to list questions that reveal your capabilities. For example, is computing speed 
desired? Something done once a month does not sound urgent, but there may be a 
publishing deadline shortly after close of business at the end of the month. So, if speed 
is of the essence, you will develop a fast algorithm based on factorization of 365 as 
5 x 73. Are daily fluctuations in /(r) to be deemphasized? You note that the monthly 
mean has been suppressed; explain what you would do about the 7-day component 
that is caused by weekends. Is the choice of the cosine function intended to suppress 
the odd part of /(t)? If there is a monthly cycle (such as accounting practice intro¬ 
duces), the end-of-month trend will be suppressed. You will investigate the effect of 
varying the origin of t. Finally say how you would invert the transformation, which 
was the ostensible assignment, trying to say something that will give you an advan¬ 
tage over other prospective consultants whose reports will be compared with yours. 
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44. A ray traversing an inhomogeneous medium with a slowly varying refractive index n 
suffers curvature equal to the gradient of n in the direction transverse to the ray. For 
rays only lightly inclined to the z-axis, d 2 rjdz 2 = dnfdr = -(ln^/h 2 )r. Recalling that 
d 2 r/dx 2 = -of hr has solution A cos <ox + B sin ojx, applying the boundary conditions 
r = 0 and dr/dz — tan i at z = 0 gives 

r — tan i sin tox, 

where to = \/2n 0 /h and is related to the quarter period L by to = 7r/2L. Hence 

L = 7rli/2V2n' 0 - 


CHAPTER 14: THE LAPLACE TRANSFORM 


too , f 1/2 

3. («) F(p) = = \ _ l/2 e pl dt 

= = -p-V“ p/2 - e p/2 ] 

= 2p _1 sinh(p/2), all p. 

w m = JV** = -p"V p -1 ),aiip. 

(c) F(p) = = {^(1 - \t\)e-r*dt 

= ^(1 + t)e" p ' dt + }’ (1 - t)e-* dt= .... 

These simple integrals may be evaluated in several more lines but application of the 
convolution theorem (p. 365) to (a) yields F(p) = 4p~ 2 sinh z (p/2), all p. 


5. See p. 540. 


8. Using the relation tan ix = i tanh x and remembering that the given impedance 
is reactive we may write the cable impedance as Z(p) = 75 tanh (10 _8 p/27r) = 
Zo tanh rp — Zo(l - e~ 2rp )/{l + e~ 2rp ) where r = 10“ 8 /27r seconds = 0.6 nanoseconds is 
the time taken for an electromagnetic wave to travel the length of the cable. Evidently 
the cable is a convenient piece about 12 cm long. 


m = [z (p)]-'V(t) = [Z(p)]-'8(t) 

V 


1 - e~ 2rp 


8(t) + e~ 2rp 


7-1 


1 - e~ 2Tp 




— 2r 
2t 



The first term comes from Table 14.2. The second term, which is an identical train of 
impulses delayed by a time 2s, the round-trip echo time, comes from the shift theorem. 
The net result is as shown: 



Solution to Problem 5. 
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H 2T b 


The doubling that occurs after the first current pulse is due to momentary superposi¬ 
tion of a reflected wave on the echo. 

Only the operational layout for this problem is given as the conventional presen¬ 
tation is too bulky. 



where A = a 1 /{a 1 + to 1 ), B = co/2i(a — ico) and C = —co/2i(a + iftj). Hence 
1(f) = R A [c?{c? + ft) 2 )" 1 e - " 1 + Be t) 

= R ' (a 2 -t- w 2 )" 1 [cAc + w 2 cos ft)f — (oa sin tot] H(t) 

= (1 + ft) 2 C 2 R 2 ) -1 [R _1 e _trt + Rft> z C 2 cos cot - wC sin cot] H(t). 


13. Suppose that steady direct current 7(f) = H(t) appears at t = 0 in a parallel combina¬ 
tion of L and C for which Z(p) = LpfLCp 2 + 1) _1 and calculate the voltage V(f) from 
the operational expression 

V(t) = Z(p)H(t) 

= Z(p)p _, S(f) 

= C'(p 2 + 1/LC) -1 5(7). 

From the table of transforms we see that 

V(f) = C _1 ft) _1 sin (ot H(t). 


14. Consider a series L, C circuit for which Z(p) = Lp + ( Cp) 1 through which a current 
sin cot H(f) flows. The voltage V(t) will be expressible in operational notation as 

V(t ) = [Lp + ( CpY x ] sin cot H(t). 

Now from Table 14.2 


Hence 


sin cot H(t) = ft)(p 2 + ft> 2 ) 1 6(f). 
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V(t) = [Lp + (Cp)-']co(p 2 + <a 2 ) 1 S{t) 

LCp 2 + 1 

= WW)^ (f) 

- Lwp~ l 8(f) if CD 2 = 1/LC 
= LcoH(t). 

Thus, the flow of a.c. in this circuit is associated with the appearance of a d.c. voltage 
across it. The direct voltage exists entirely across the capacitance. Alternating voltages 
appear across the L and C but there is no net alternating voltage across the combina¬ 
tion. 


21. The standard explanation of existence of several time functions with the same Laplace 
transform refers to the inversion integral (p. 381) and points out that the path of inte¬ 
gration defined by the constant c may have several significantly different relationships 
to the poles of the transform. Thus in lire problem at hand where poles occur at p — 2, 
1 and -1 we may choose 2<c, l<c<2, - l<c<lorc<—1 and obtain differ¬ 
ent results on carrying out the integration. 

An alternative explanation starts with the theorem, that if for real a 

e-^Hlt) D F(p) —a < Rep 
then —e~ a, H(—t) D F(p) Rep < —a. 


Now/}(t) = 


1 1 , 1 - 

-e 2 - -V + -e 

3 2 6 


H(t) D 


(P - 2)(p - l)(p + 1) 


2 < Re p. 


The region of convergence is set by the term in e 2 ' as we may note from the diagram 
showing the regions of convergence of all three terms 


H-®- 

H-©- 

H-©- 

H—/.to- 

J___ 1 _I_I_ 

-10 12 Rep 


Now consider the following functions derived from /,(f) by altering one or more terms 
as shown: 


m = - ^H(t) + V'H(f) 

Ut) = -|e"H(-f) + 

Ut) = -^H(-t) + ^H(-t) - ^T'H(-f) 

The following diagrams show the existence of strips of 
three terms. 


1 < Rep < 2 
-1 < Rep < 1 
Rep < —1. 

convergence common to all 
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-(EH 

h-@— 
©— 
H /2(o H 


- ®— 

-<D-H 

h—<D- 

h—/s(o—H 


-®-H 

-(2)-H 

-<D—H 

-/ 4 (o—H 

_i_l_i_i_ 

-10 1 2 Re p 

23. If there was no stored energy before the voltage v(t)H(t) was applied, all integrals from 
0 — to oo would be the same as integrals from — oo to oo because all integrands from 
—oo to 0— would be zero. Then the situation would be the same as for the two-sided 
Laplace transform and the theorems for the special transform would be the same as in 
Table 14.1 for the two-sided transform. There would be no occasion, as in the example 
set out on p. 396, to include terms representing initial behavior /(0+), /'(0+), etc. 

But if energy is present prior to the application of v(t)H(t) an adjustment will be 
needed. The values of /(0-),/'(0-), ... will suffice to define the prior state. The spe¬ 
cial transform of f'(t) may be evaluated by integration by parts as follows. 

= [e-*fmL + pjyx/m 
= -no-) + pF-ip). 

Likewise 

r oo foo 

J o e-*r(t)dt = [e-P'/W- + pj^e ^nm 
= -no-) - p/( o-) + fF-<p). 

Example. A voltage source in series with a resistance R and capacitance C gener¬ 
ates a voltage V 0 H(t) but just before the voltage jumps from zero to V u a current 1 0 is 
flowing. Find the subsequent current. 

The differential equation is 

C -1 /(f) + Rl'(t) = V 0 8(t). 

The subsidiary equation is 

C -1 f(p) + R[pl(p) ~ /„] = n- 

The bars refer to the special transform, and we have used the derivative theorem. Solv¬ 
ing for I(p) we have 
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m = 


Vq + Rig 

Rp + C” 1 


= (Vo /R + 7 0 ) 


1 

p + R-'C- 1 ' 


Inverting the transform we have 

7(f) = (V 0 /R 4- I 0 )e-‘ /RC t > 0. 

(Verify that the transform of e~ l/RC is the same whether the lower limit of integration 
is 0- or 0+.) 

Comment. Note that post-initial values such as 1(0+) were not needed. It seems 
more natural to be given the prior state and the excitation and to be asked to find what 
happens than to be given the excitation and part of what then happens, with the task 
of finding out the rest of what happens. 


25. Transforming the differential equation term by term 

sY(s) + Y(s) - 0 
(s + l)Y(s) = 0 

Y(s) = 0 + JcS(s + 1) 

because Y(s) can contain a delta function of any strength k at s + 1 = 0. Inverting the 
transform, 

y{t) = ke 1 

and the initial conduction fixes the value of k at y(0+). 


26. This interesting problem illustrates two philosophical points. First let us approach it 
by forming the subsidiary equation 

0 I(p)Lp + 0 J(p)R = 0 V(p). 


The zero subscript indicates one-sided Laplace transform. No term in 7(0+) is required 
because at t = 0 the circuit was as yet quiescent. Thus the first comment is that the ap¬ 
pearance of initial values on the RHS in the traditional layout of initial value problems 
(p. 396) is restricted to situations where the switching on takes place at t = 0. In a vir¬ 
tually identical problem where switching on occurs later, these terms are dispensed 
with. And yet we expect to get the solution nonetheless. Continuing, we solve for J(p) 
to find 


dip) - 


o V(P) 

Lp + R 


Let us take a particular case where V(f) - H(t — 1) and we know the solution must 
turn out to be 


7(f) = R -1 (l - e~ R ^ L )H(t - 1). 

Since 
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p~ 1 e~ p 
0 ^ = Lp + R 
= 

pip + wr 

From p. 388 this gives 

I{t) = R -1 (l - e^W-^Hit - 1 ), 
which is the correct response. 

Had the voltage been applied at t — 0, it would have been necessary to give 1(0 +) 
in order to get a solution; but in the present problem it was not necessary to be given 
the analogous 1 ( 1 +). 

The second comment is, why should it be necessary to be given partial informa¬ 
tion about the response current, such as initial values, when the response is what we 
are charged with discovering. Does it ever happen in practice when we need to find 
out what current will flow that a circuit (or equivalently its differential equation) is 
given, that the exciting voltage is given, and that in addition some intelligent agent is 
able to furnish Z(0+), P( 0 +), J"(0+), -. ■? In other words, in some way, someone knew 
what was about to happen next. Possibly the reason for the appearance of such unreal 
problems in books is that traditional boundary value exercises in standard texts on dif¬ 
ferential equations (such as finding the trajectory of a ball when height and tilt of the 
cannon are given) have been unthinkingly translated from the space to the time 
domain. 

27. Let lit) = Sit) + aSit - 1) + a 2 5(f - 2) + .... 

Then J(p) = 1 + ae~ p + a z e~ 2p + ... 

= (1 - ae~ p )-\ 

In terms of frequency, the transfer function T(J) is given by 

Tif) = (1 - ae- a ”f)-\ 

This result could be produced by a resistance in parallel with a lossy, nondispersive, 
short-circuited transmission line. 

30. (a) Express III(f)H(f) as the sum of its even and odd parts: III(f)H(t) = |lll(f) + \ sgn t. 
The transform of jlll(f) is \lllf, which supplies the missing even part of the trans¬ 
form. 


CHAPTER 15: ANTENNAS AND OPTICS 

1. TWo antennas with beamwidths that are equal by some customary measure such as 
the angle between half-power directions may have quite different equivalent widths 
of their angular spectra. For example, since P(s) can in some directions be opposite in 
sign to P(0), the value of / P(s) ds can be sensitive to the sign of sidelobes which have 
little to do with the concept of beamwidth. As an extreme example, the two aperture 
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distributions n(x/1000A) and n(x/1000A) — n(jc/10A) are quite similar and have sim¬ 
ilar beams, but the equivalent width of the angular spectrum of the second is zero. 

As a different kind of objection, an antenna, whose beam was shifted (by phas¬ 
ing) with no change of beamwidth at all (as measured in units of s between half-peak 
points), would exhibit a change in the equivalent width of P(s) because P(0) changed. 

2. The diagrams are of the kind shown in Fig. 2.10 (p. 20) and in the answers to Prob¬ 
lems 2.20 and 2.21 . The Cornu spiral arising in optical diffraction is a diagram of this 
kind. Although the function domain and transform domain are normally regarded as 
distinct, it is interesting to note that the plane of these diagrams may be regarded 
equally as the complex plane of the aperture field E or of the angular spectrum P. The 
phasor AB is the resultant of the elementary phasors E{x/ A) d(x/\) exp(-z'27rsx/A) and 
gives the angular spectrum in amplitude and phase for particular values of direction 
s. In each diagram the arc length is the same. 


ImE(x) 


A 


Path difference = 0 
B 

-►-ReE(x) 




p.d. = A/2 


A 



3A/2 



2A 


5. The first null on one side is in the direction where the path difference to the end ele¬ 
ments of the aperture is — A/2, and the second null is where the path difference is — 2A. 
The third null is at —2.5A. In the direction normal to the aperture (path difference to 
ends = 0) the resultant AB has a magnitude 2~ 1/z times the arclength AB. Moving away 
from the normal we can see graphically that the resultant decreases toward the side 
considered above (see p.d. = -A/4) but increases toward the other side. Representing 
the aperture distribution by E(£) = — iTI(2£ — |) + I"I(2£ + \), where £ — x/w and w is 
the full aperture width, we obtain for the angular spectrum 


P(s) = (io/A) 


-ie ,m ~ sine a + e ,w ^ sine a 
2 2 


( 1 ) 


where a = ws/2\. To find the location of the principal maximum we can solve 
dPIds = 0, which is rather tedious. Alternatively, we can establish by rough sketches 
that there is a maximum in the vicinity of p.d. = 3A/8. The magnitude may then be 
calculated to be 1,85 P(0), and of course the phase is -45° by symmetry. 
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11. One way is to construct a pinhole camera, i.e., an opaque sheet of material containing 
a pinhole behind which is a photographic plate or other array of detectors. 

If the intensity is so low as to require an unreasonably low exposure time the hole 
size may be increased. If the blurring due to increased hole size becomes the limiting 
consideration, increased sensitivity can be gained by the use of several small holes dis¬ 
tributed somewhat at random. This will produce a superposition of faint images that 
can be combined, for example by autocorrelating the total image. As with all autocor¬ 
relation functions, there will be a sacrifice of phase information. 

Another approach is to make use of the fact that x-rays do reflect at highly graz¬ 
ing incidence, which in effect lengthens the wavelength. A paraboloidal annulus re¬ 
mote from both the vertex and the focus will act as a lens. 

16. It is true that the field intensity on the ground vertically below the aircraft is inde¬ 
pendent of the spacing of the slots (assuming that the slot fields are kept the same). 
However, it is wrong to deduce from this that it is permissible to pack the slots tightly, 
because the gain, which is to be a maximum, depends not only on the field intensity 
vertically below, but also on the input power required to maintain it. The structural 
expert, although possessing a wide background, does not take this into account and 
therefore his statement should be accorded only the respect due to an expert speaking 
outside his field. 





The antenna expert's assistant, a mathematically inclined fellow, is right in saying 
that the power radiated is the sum of the powers passing through each slot, but of 
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course means time-averaged powers. Rayleigh's theorem, however, applies instant by 
instant, and the power flowing through the slots at one instant may flow back in a 
quarter cycle later. This would be the case with an aperture excited by a field that pro¬ 
duces evanescent waves but does not radiate at all. The actual antenna problem in¬ 
volves some power flow of this kind. 

To maximize the gain while keeping the field vertically below the same, we have 
to minimize 

| } 2 ?rP„(M>)da 

In the illustration, all cases show the same radiation on axis. The tight-spacing 
case shows a fat beam which means power is wasted in unwanted directions. The open¬ 
spacing case shows power being wasted in a grating lobe. The optimum occurs just as 
the first grating lobe is sliding over from the evanescent regime (sin 0 > 1 ) to the ra¬ 
diating regime. This optimum is a flat one which in practice is of the order of four- 
fifths wavelength spacing. 

18. Consider a ring of 96 equispaced two-dimensional unit delta functions on a radius a. 
The diametrically opposite pair at (a, 27rp/96) and (a, tt + 2vp/96), where p = 
1 , 2 , ..., 48, possess an angular spectrum in the form of a cosinusoidal corrugation 
with isolines perpendicular to the line joining the two delta functions, or 2 cos {2iraQ/ A) 
where Q is measured perpendicular to the isolines. For any point in the (/,m)-plane, Q 
is given by Q = l cos (27rp/96) + m sin (27rp/96). Adding the contributions from the 48 
pairs of deltas, we see that the angular spectrum of the 96 deltas is 

47 

^ 2 cos {( 2 t 7 «/A)[ 1 cos (27rp/96) + m sin (27rp/96)]}. (1) 

p = 0 

The summation, if carried to p = 95, would give double the result. Note that a/X — 214 
(not 430). 

Now use q for radial variable in the (l,m) or angular spectrum plane, instead of r 
as in the problem wording, and reserve r for radial variable in the antenna plane, or 
(x,y)-plane. 

The ensemble of point deltas, when the points are extremely numerous, is like a 
ring delta of strength 96 given by 96 (27ra/A) _1 8(r - aj A) where r is the dimensionless 
radial coordinate, measured in wavelengths, in the antenna plane; in fact this ring delta 
can be thought of as deriving from the leading constant in a Fourier series 
96 (273-fl/A) -1 8 (r - fl/A)(l + 2 2 cos nd) for the periodic function of angle constituted 
by the 96 deltas. This leading term transforms into a J 0 function as we know from the 
transform pair 

8 (r - a/X) 2 D (2na/X) J^iraq/X) (p. 338). 

Later we establish the more general transform pair 

8{r - a/X) cos 96 nO 2 D (27rfl/A) /%„ {/Irraq/X) cos 96 nd, 

where r = A^x 2 + y 2 ) 1 ^ if x and y are rectangular coordinates in the antenna plane. 
Thus the angular spectrum is proportional to 

96 

jJ/l-naq/X) + 2 Jc^J/Ziraq/X) cos 96 nd. 
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If we are not dealing with delta functions, but elements whose angular spectrum is 
P(q), then the foregoing "array factor" would be multiplied by P(q) (p. 413). 

The Bessel function 2/ % (2iraq/X) has a maximum of 0.29 near 2-iraq/X = 99.72 and 
is extremely small for smaller arguments, varying roughly as ( Irraq/Xf 6 . Its first zero 
is at liraqlX — 104.72. In this vicinity the second term J 198 is absolutely negligible. In 
the vicinity of the origin both are negligible and so the diffraction pattern is propor¬ 
tional to Jo to high precision. In the vicinity of 2-naqjX = 100, the envelope of Jo(z), cal¬ 
culated from the asymptotic expression ( 2 /irz) ,/2 , is about 0.08 and therefore interacts 
with 2 /^( 2 ) to produce important intensity variations. 

The figure shows positive crest lines of the cosinusoidal corrugations corre¬ 
sponding to p = 0,1,2. Clearly the sum of such corrugations, near the origin, should 
approximate a J 0 function because J 0 can be defined as the limit of such a sum as the 
number of elements approaches infinity (see footnote p. 336). The next point of inter¬ 
est is at A where many of the positive crests reinforce. Exactly the same happens at B, 
C, etc. Similar reinforcement occurs again at 96 further points A', B', etc., points which 
are about twice the distance from the origin and so on to higher orders. 

Midway between A and B troughs of the corrugations reinforce, but this does not 
lead to an intensity maximum in this case because corrugations at other values of p 
tend to have compensating crests there. Even so, ( 1 ) is a perfectly good formula for 
computing the intensity distribution. To see analytically what is happening in the first 
order grating response it is more direct to consider f/ 0 (z) + 2J 96 (z) cos 96 0] 2 . It is help¬ 
ful to know that Jo(z)~( 2 / 7 rz ) 1/2 cos (z - ir/4) 96 , that the first maximum of J„(z) is near 
z = « + 0.81n 1/3 and the adjacent zero near z — n + 1.86n 1/3 (Abramovitz and Stegun, 
p. 371). 

Appendix to 15.18 
To show that 


8 (r — a/ A) cos n6 2 D (2va/X) cos n^>(—i) n }„(2-7raq/X) 
we need to draw on the basic integral 

) n ( 2 ) = ^ J n cas m/3 e 12 p dp 

(Abramovitz and Stegun, p. 360, no. 9.1.21.) 

F(l,m) — f“ [“ f(x,y)e- i2 ^ h+m ^ ) dxdy 

J -OO J —OO 

= J“J' r f(x,y)e~' 2irqr ^ dr dd 
= f*”def™8(r - a/X) cos n8 e~ av, r dr 

= ^dB cos n0 e-'^^W-tXa/ A). 


(p. 247) 


Put /3 = 8 - (f>; then 


= (a/X) j ^ 77 cos (w(/3 + 4>)] e -*"*™ eo * d/3 
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= («/A) cos ti(f) cos nfi e i2n * a/x '> cos fd/3 + null term 
- (2mj/A) cos tup T J„(~27raq/\). 

As a special case 

S(r - a/ A) cos0 2 D -i(27rfl/A) cos</> } x (2ircuj/\). 

Rotating f (x,y) in its own plane rotates the two-dimensional Fourier transform through the 
same angle. Therefore cos may be replaced on both sides by sin. By the addition theorem 
cosff may be replaced by exp i<9 and cos<fr by exp i<f>. 



19. An antenna array may be correctly phased to point in a particular direction by the in¬ 
sertion of extra lengths of transmission line arranged as shown. If the transmission 
lines are air-filled, so that the wave velocity in the line is the same as in free space, 
then the extra lengths (shown heavy) are such that the transmission line layout has the 
direction A A' parallel to the wavefronts coming from the direction of maximum re¬ 
ception. Such an array can point in only one direction at a time because the phase gra¬ 
dient along the array is fixed by the transmission line lengths. 

An array of pressure gauges on the sea bed could be connected together in a sim¬ 
ilar way by tubing; but if independent pressure records are made, they may be com¬ 
bined additively with artificial insertion of time delays equal to what would have been 
inserted by extra lengths of tubing. Thus an array of recording systems permits retro¬ 
spective processing for several directions (eight?). With one receiver one looks in only 
one direction at a time. 

The radiofrequency analogy using multiple receivers would require local-oscilla¬ 
tor frequency stability to a faction of one radiofrequency period over the observing pe¬ 
riod, which is available at some expense. A more practical procedure is to divide the 
antenna outputs several ways and to apply the numerous receivers to the numerous 
two-antenna combinations that can be formed by direct interconnection ( Proc. IEEE, 
vol. 61, no. 9, pp. 1249-1257, September 1973). 

Direction finding on traveling ocean waves is feasible in principle in the open 
ocean but near the coast is subject to complications introduced by reflection and 
refraction. Wave velocity c depends on water depth h as given by v 2 — 
(g\/2'n) tan (2ir/i/A). On the deep ocean, 1 km waves travel with a velocity of 39 ms -1 
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(frequency of 0.39 Hz); but over the continental shelf (h = 200 m) the velocity drops 
and the wave direction is changed by refraction. In shallower coastal waters the wave 
direction will be nearly perpendicular to the coastline, independent of the original di¬ 
rection. Coastal scattering and reflection confuse the situation further. 



21. Let ej be the instantaneous voltage that the element labeled j delivers to the common 
point. The product of two radiofrequency voltages contains a steady or slowly-vary¬ 
ing component of interest and a component at twice the radio frequency whose rejec¬ 
tion will be indicated by time-averaging brackets ( }. The interferometer response is 
proportional to the time average of the product of the voltages delivered from the two 
sides, or 

((^i + e 2 + ... + £ 16 )(ci 63 + £32.5)) 

= (( e l e l65 + e 2 e 16.5 + - • • + e l6 e l65 ) + ( e l e 32.5 + e 2^32.5 + • - ■ + f u^ZLs))- 

Each of the 32 terms is the response of a two-element interferometer; thus the term 
is the response of a two-element interferometer of spacing (j - i) af A, where A is 
the wavelength and a is the unit of x expressed in the same units as for A. Let iff — iras/k 
where s = sin 6 as on p. 277. Then 

M oc cos[(/ - i)¥], 

as may be deduced directly from the angular spectrum of two narrow antennas spaced 
(j - i)a apart. The total response is thus 

(cos iff + cos 3 iff + ... + cos 31^) + (cos 33 iff + ... + cos 63i ft). 

We recognize this expression as a Fourier series; the usual formula is 


N —1 

2 ^ c °s = 

n=1,3,5— 


sin 
sin ^ 


(N even). 


(1) 


For N = 64 the width to half response is given by A't = 0.059 or As — 0.019A/a. 

A single antenna of length 47a/A has a power response sine 2 (48as/A); since 
sine 2 0.44 = 0.5, the width of half response is As = 0.018A/a. Thus it is interesting to 
note that the interferometer has a beamwidth similar to that of a conventional array 
about half as long again. This fact can be associated with the level transfer function of 
the interferometer contrasted with redundant emphasis on low spatial frequencies by 
conventional antennas. 
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The antenna array described was demonstrated with a spacing of 83.68 wavelengths 
at a wavelength of 9.107 cm, and achieved a beam width of 52 arcscconds ( Astrophys. 
/., vol. 138, pp. 305-309, 1963). This was the first time that an antenna reached the an¬ 
gular resolution of the human eye. The breakthrough was based on a novel technique 
of equalizing transmission line lengths to geodetic accuracy, about 1 in 10 5 (IRE Trans. 
Ant. Prop., vol. AP-9, pp. 22-30; 75-81, 1961). 

The approach to Fourier series of p. 208 (and Fig. 10.12) may be applied to the 
present periodic function as follows. 


N —1 N 1 

2 2 cos nx D 2 [^( s + n / 2jr ) + 5(s “ n / 2ir )] 

k = 1,3,5... n-l,3~ 


M’ “ H 


n(7TS/N). 


= 7rm| 

Noting that, by the inverse shift theorem, 

^m(x/Tr) D TTlil^ 

and that e‘ x = (~l) m at x = mi t, which is where III(x/-7r) has its impulses, we see that 

OO 

(2)[e“ U\(x/tt)] * [(N/7r) sine (Nx/7r)] = (-l) m N ^ sincf(N/ir)(* - m-n)} 


n 5 ~ \v. 


transforms into (2), by the convolution theorem. The form (2), a set of narrow sine func¬ 
tions of alternating sign, is an alternative to the compact form (1). The latter may be 
derived by substituting 2 cos n x = + e~ a in (1) and summing the N terms of the re¬ 

sulting geometric series. 


24. (a) Let E(x/ A, y/A) represent the aperture distribution, whose FT is P(l,m), and let ( R,S ) 
be a coordinate system in the same plane rotated counter clockwise through an an- 
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gle a with respect to (x/ A, y/A). Let g a (R) = E(x/ A, y/\)dS. The one-dimensional 

FT of g„{R) gives a cross-section through P(l,m) in the a-direction. Let us compare 
the principal cross-sections obtained as FTs of g 0 (R) and 

P(/,0) = v 3sinc 2 / (1) 


v '3 

P(0,m) = — [sinc 2 <r + (iira) *(1 - cos7r<r sine cr)] 


( 2 ) 


where n - ( v 3/2)m. LetP(/ 0 ,0) = |P(0,m 0 )| - 0.707. Then we find that 4 = 0.502 and 
mo = 0.492. Thus the half-power contour is highly circular (circular within one per¬ 
cent). The contours within the half-power contour will be even more closely circu¬ 
lar in spite of the triangular shape of the aperture. Clearly the central curvature of 
P{l,m) does not depend strongly on direction. 

(b) According to the second moment theorem (p. 339), the central curvature of the two- 
dimensional transform is proportional to the second moment of the original func¬ 
tion. So we can study the nature of P(l,m) near its origin by examining the second 
moment of the triangular aperture. If we translate the problem into mechanics it 
becomes the question of the moment of inertia I a of a triangular lamina about an 
axis lying in the plane of the triangle and passing through its centroid in a general 
direction a. The moment of inertia l a of a flat plate depends on position angle a of 
the axis in such a way that if I a is plotted against a in polar coordinates the result 
is a central ellipse. [If a is measured from a principal axis of inertia the relation is 
I a = l xx cos 2 a + fyySin 2 a.] The only ellipse with three axes of symmetry, which is 
what an equilateral triangle demands, is a circle. Hence the moment of inertia, or 
second moment, of the triangle is independent of direction. Consequently the cen¬ 
tral curvature of P(/,m) is strictly independent of direction. This is one way of un¬ 
derstanding why the contours surrounding the origin are approximately circular. 



Fig. 21.15.24 The 3dB contour of the radiation pattern of a triangular aperture 
is almost circular. 
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Well away from the origin the pattern \P(l,m)\ 2 must be periodic in angle with 
a period of 60°, i.e., it possesses six-fold symmetry. The reason for this is that the 
power radiation pattern, in any plane through the beam axis, is an even function. 
We can see from Fig. 1 that the minor departures from circularity are in the form 
of six bumps spaced 60°. Numbers show radial distances. 

(c) From (1) we see that P(l, 0) has nulls at / = ±1, ±2, etc. But from (2) we see that 
there are no nulls on the m-axis, because at the points where the real part is zero 
the imaginary part is non-zero and at the point (m = 0 ) where the imaginary part 
is zero the real part is non-zero. Hence |P(0,m)| 2 , which is the sum of the squares 
of the real and imaginary parts, has no zeros at all. We can therefore say that there 
is no null contour surrounding the main beam. (This does not say that there is no 
null contour. However at the moment we cannot say whether the nulls on the /- 
axis are isolated points, or lie on closed loops or lie on loci that run out to infinity.) 

26. With a spacing L A between elements the aperture distribution will be 
[ 8 (x A + |L a ) + S(x A — ^L a ] * E 0 (x A ). So the field radiation pattern will be proportional 
to sin ttL x s multiplied by the broad angular spectrum of a single element. The inner¬ 
most maxima of the power pattern will be at s = ±|L a . For s to be 0.5" = 2.4 x 10 -6 
radians, means L A = 2.1 X 10 5 . At a wavelength A = 20 /Ltm the baseline length L of the 
interferometer would be approximately 4 m. This scheme was proposed ( Nature , vol. 
274, pp. 780-781,1978) and used to observe the bright star Betelgeuse's immediate sur¬ 
roundings, which are too faint to be seen by normal astrophotography (Nature, vol. 
395, pp. 251-253, 1998). 

27. (a) The overall width is 10 wavelengths, (b) The Fourier transform of E(f) is 
( 20 / 7 r 2 s 2 )(sinc 10s — cos ICbrs). (c) Tabulating P(s) shows a minimum of —0.0865 at 
s = 0.01835, with a corresponding dB level of 20 log 0.0865 = 21 dB. 


CHAPTER 16: APPLICATIONS IN STATISTICS 

3. If you purchased 10,000 ordinary 1 percent 100-ohm resistors, you could reasonably 
expect that their mean resistance would be between 99 and 101 ohms. You could hardly 
expect the manufacturer, in testing his 1 percent product, to control meteorological fac¬ 
tors (temperature, humidity, cleanliness of contacts, supervision of technicians, absolute 
calibration of meters, etc.) so that his resistance measurements would be in agreement 
with the National Institute of Science and Technology to much better than 1 percent. 
It would be unreasonable if the mean resistance of your 10,000 1 percent resistors was 
100.1 ohms and the total resistance of the series combination 1,001,000 ohms. If you re¬ 
peated the purchase many times, buying from the same original batch, the spread could 
indeed possibly be as little as one part in 10 4 ; but about a mean that could disagree 
with an absolute standard by much more than one in 10 4 . 

8 . A probability distribution P(x) being positive is expressible as |/(x)| 2 . Let f(x) have a 
Fourier transform F(t). Then if 4>(t) is the Fourier transform of P(x), 

PM d m. 
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it follows from the autocorrelation theorem (p. 122) that 

m = F( t ) * F(ty 

The following summarizes the relationships. 

f(x) D F(t) 

|/(x)| z or P(x) D F * F or <£(f). 

A particular example is 

sech ttx D sech irt 

sech 2 ttx D 2t cosech vt (p. 266). 

Thus 2t cosech Trf is the autocorrelation function of sech irt. It is also the autocorrela¬ 
tion function of sech [7r(f - 1)], of SFjsech x sgn x} and in general of S'!sech x e"***}, 
where 0(x) is any arbitrary phase, because of the fact that /(x) is not uniquely defined. 

10. Under convolution variances add, but second moments about the origin do not in gen¬ 
eral add. However, when probability distributions are convolved, then the second mo¬ 
ment about the mean is the same as the variance (because the integral of the proba¬ 
bility distribution is unity). Therefore we shall consider the third moment about the 
mean since there is no reason to think that third moments in general will add. 

Let the probability distributions f(x) and g(x) have their means at x - 0. Then 
F(0) = G(0) = 1 and F'(0) — G'(0) = 0, where F and G are the Fourier transforms of/ 
and g. The third moment of /(s) is 

Too 1 

and 

=--—-[F^G + 3F"G' + 3F'G" + FG^Iq 

(-Htt) 3 

= ^~^tF“(0) + G"'(0)] = (x 3 ) f + (x% 

Further problem: Do the fourth central moments add? (No). 

We can show that 

(A*s = (A + *<A<A + <A 

The fourth cumulant (x 4 ) — 3(x 2 ) 2 is additive; in fact this is the defining property of 
cumulants. 

13. Write the Poisson distribution in delta function notation as if n were a continuous vari¬ 
able. It is 

S(x) + xS(x - 1) + ^y6(x - 2) + ... 

Take the Fourier transform to get the characteristic function. 
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«K0 = [l + + 

= exp (xe' , )e _x 
— exp (xe 1 * — x). 



16. Let Pj(R)dR be the number of resistances in R±\dR and let P 2 (G)dG be the number of 
conductances in G ± jdG. When R = 1/G, these numbers must be equal. In this case, 
|dR| = G~ 2 \dC\. Hence from 

P l (R)dR = P 2 {G)dG 

we deduce 

I dR I 

del 

= G 2 P,(R) 

= 0.05G- 2 n(^G-5). 

As the graph shows P 2 (G) is by no means flat-topped. 
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CHAPTER 17: RANDOM WAVEFORMS AND NOISE 

1. Let x(t) have a Gaussian amplitude distribution and zero mean and a power spectrum 
W(/). The peak-to-peak value of a long segment x(f)n(f/T) = g(t) is 

max[g(f)] - min[g(f)] 

and the standard deviation a is 


1 ^ 

T 



dt. 


As T —> oo, the first of these expressions increases without limit while the second does 
not. Therefore, one thing to investigate is how a factor of 5 could be found to relate 
two such unlike expressions. 

One approach is to calculate the peak-to-peak value as a function of lire segment 
duration T. The probability that g(t) exceeds 2.5 n is 1 part in 161. Thus, starting from 
a trough where g(t) < — 2.5tr, we might expect the order of 200 "cycles" to elapse be¬ 
fore a peak occurred with g(t) > 2.5tr. By "cycle" is meant a time period (A f)~ l where 
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A/, the rate of occurrence of effectively independent values, is calculable (p. 468) from 
the autocorrelation width of the power spectrum. 

By reference to a table of probabilities for deviations from the mean of a normal 
distribution and rounding off heavily we find the following. 

( Peak-to-peak)/a 4 5 6 7 

Number of “cycles" 50 200 1000 6000 

It appears that on segments several hundred "cycles" long an accuracy better than ±20 
percent will be achieved by use of the 5 a rule. Records for inspection by eye (and ap¬ 
plication of rules of thumb) are not likely to be much longer. Records longer than 50 
cycles would yield accuracy better than 20 percent. Short records based on fewer than 
50 independent values would have less accuracy, but in such cases estimates of cr are 
not defined to much better than 20 percent. So it seems that the 5cr rule makes sense. 
Further problems suggested by this discussion are: 

(a) Find the precise value of the factor (peak-to-peak)/tr as a function of the number 
of "cycles" N. 

(b) Find a fast procedure for estimating N which does not require determination of the 
whole power spectrum of the sample but works instead from countable things like 
peaks and zero crossings. 

(c) Is the peak-to-peak value as stable a statistic as say the difference between the sec¬ 
ond highest maximum and the second lowest minimum? 


2. Consider a signal waveform H exp{ - nt 2 ) whose width at half peak is 0.94, and whose 
slope at half peak is 1.47H. Let <r„ be the root-mean-square noise. The procedure for 
measuring tine width is first to find the half-peak points on the given record and then 
to measure the time interval between them. Because of the slope, a vertical error <r„ 
will become a horizontal, or timing error 0-J1A7H. The error in width, obtained by 
subtracting two times, each with its own independent error, will make a width error 
2’cr n /1.47H. Equating this to 5 percent of 0.94 gives Hjcr n = 20. This seems equitable. 
A more refined measuring procedure is to reduce a n by first convolving the record with 
another Gaussian waveform and then correcting for the increased width. In the theory 
of this procedure it is necessary to increase the factor 2 J because the half-peak timing 
errors come to be correlated. 

4. (a) The expected number of upcrosses per second v is equal to the probability that a 
value x t will be negative and that x l+l will be positive. Let p(x,y)dx dy be the prob¬ 
ability that x, will be found at x 4 - \dx and r t+l will be found at y ± \dy. Put 
a 2 = (xj) = (jtf +] ). The correlation y x between successive values is given by 
■yi = (xpc, + ^/o 2 . From texts on statistics we know that p(x,y) is given by the two- 
dimensional normal distribution 

P (* ,3/ ) = yx) 1 ' 2 eXP ["t* 2 “ 2*3/ + l/J/M 1 ~ Yi)] 

a function which is represented by a few contours in the left figure. 
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x 



So v is equal to the shaded fraction of the volume of p{x,y) in the left-hand figure or 

foo (0 
v = \o dy 

Since the contours of p(x,y) are similar and similarly situated concentric ellipses, 
this integral may be simplified by noting that it is equal to the shaded fraction of 
the area of the ellipse in the right-hand figure. The equation of the ellipse is 

x 2 y 2 

y - -y, xy + y = const. 

Its axes lie at ±45°; substituting y = ±x gives the major and minor semiaxes: 

a 2 = — -—, b 2 = — J a 2 /# = (14- y,)/(l - y,). 

1 “ Ti 1 + Ti 

Expand the ellipse NW-SE by a factor a/b, converting it into a circle; this leaves area 
ratios unchanged. So v is equal to the hatched fraction of the circle: 

v = 2VOQ/2it 
cos 27 tv = cos 2VOQ 

= cos 2 VOQ - sin 2 VOQ 

= yyy (since cot VOQ = RQ/OR = RQ/RP = a/b) 

= Tv 

v = (27r) 1 arccosyi- 

When there is no correlation between successive terms (y y — 0), the expected 
number of upcrosses per second is 0.25; i.e., the average period between upcrosses 
is 4 seconds. 

(b) The central value of the second difference of {y f } is (y! - y 0 ) - (y 0 - yi)or2(yj - 1) 
since y 0 = 1 by normalization. Hence knowledge of yi fixes the central second dif¬ 
ference of {y,} and vice versa. The second difference approximates to the curvature 
F"(0) of the smooth curve when 1 is approximately equal to unity, provided {/,} is 
of such a character as to define a smooth curve. Now 
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■yj = cos 27 tv 4= 1 — 277V + .... 

Hence when y, = 1, 

(2w) 2 = 2(1 - Tl ) = — F"(0). 

Let SS* be the Fourier transform of the smooth curve defined by unnormalized 
[{/,} ★ {/,}], whose central curvature is F''(0)[SS* df. Then 

| f 2 SS* df = — (27t)' 2 F"(0) \ss*df. 

~ f 2 S(J)S*(J)df 

—oo 

The integral in the numerator would not exist if, for example, 

SS* — sine 2 /. 

This power spectrum corresponds to taking running sums over a finite time inter¬ 
val. One might be tempted to say "white noise passed through a running integra¬ 
tor has an infinite number of zero crossings per second." This paradox will not in 
fact arise if we stick to running sums on discrete sequences. So we might content 
ourselves with observing that the integral in the numerator does exist if the range 
of / is limited to the spectral range occupied by the input signal. (It is reasonable 
to restrict the range of integration in this way since the output is unaffected by the 
filter transfer function in bands where there is no input.) Now if we apply input 
noise which has a flat spectrum up to a very high frequency indeed then die out¬ 
put will be considerably smoothed, but zero crossings will survive the smoothing 
in the sense that if we double the upper frequency limit the output zeros will re¬ 
main in the same proportion to the input zeros. If we claim to put in an infinite 
number of zeros ("real white noise") we get out an infinite number. 

This is not unreasonable behavior on the part of the filter. However, with a fil¬ 
ter whose transfer falls off more rapidly at high frequencies (or with the filter pos¬ 
tulated if we allow a non-zero rise time) zero crossings will be lost in the smooth¬ 
ing to the extent that they approach a finite limit per unit of time as the upper 
frequency of the flat input spectrum increases without limit 
(c) Maxima occur at the uperosses of the derivative. The power spectrum of the de¬ 
rivative is (27 t/) 2 times the power spectrum of the waveform. So the number of 
maxima per second is 

J/ 4 SS*d/ 

| f 2 SS* df 

The integral in the numerator shows that maxima will be more numerous than 
uperosses, and may indeed be infinite while the number of uperosses is finite. This 
may be handled along lines indicated in the previous part. But even if we choose 
a filter whose power spectrum falls off as / “ 20 , there will still be infinite numbers 
of some high-order derivative, which is just as paradoxical as an infinite number 
of maxima. Presumably we can always get rid of these difficulties (a) by not ask- 
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mg more of the output than we specify at the input, and (b) by not specifying im¬ 
pulse responses outside the realm of the physically possible. 

5. (a) The sequence {1 5 10 10 5 1}, in which the successive values are taken 
to be one second apart, has a variance o 2 of 1.25 seconds. Convolution with this 
sequence acts like a Gaussian transfer function 32(27r) 1/7 <r exp(-27r 2 cr 2 / 2 ) since 
exp(-f 2 /2<r 2 ) 3 ( 27 r) ,/2 cr exp (-27r 2 cr 2 / 2 ) (Prob. l(i), p. 130). The power transfer 
function is proportional to exp(-4irV/ 2 ) = exp(-/ 2 /2/o) where f% = (47ber 2 )* 1 . 
Hence f 0 = 0.142 Hz. 

(fc) The record of Fig. 21.17.5 has a total duration of 860 seconds and counting gives 
the total number of upcrosses as 82. The measured upcross frequency v is there¬ 
fore 0.095 upcrosses per second. The precision of this result is of some interest be¬ 
cause measuring i/ona noise sample is a practical thing to do either by hand or 
by computer. First we compare against the theory of Prob. 16.4. The expected cor¬ 
relation yi is determined from the autocorrelation of {1 5 10 10 5 1} at 
unit shift: = (5 X 1 + 10 X 5 + 10 X 10 + 5 X 10 4- 1 X 5) + (1 + 25 + 100 + 
.100 + 25 + 1) = 0.833. Then 

y — (27t) _ 1 arccos 0.833 = 0.93 s -1 . 

This agreement to within 2 percent is quite impressive. The precision may be in¬ 
vestigated empirically to gain a feel for the length of record that might be required 
by plotting the serial number n of each upcross against its time of occurrence t„. 
Using the method of Prob. 17.1 we read off At, the r.m.s. fluctuation of t„ from the 
trend value v~ l n as 12 seconds. Then Ay = (Af/t^Jy is the r.m.s. error in y and 
Av/y = 12/860 = 1.4 percent. This calculation, which is very rough, shows how the 
general order of precision can be arrived at empirically in the absence of prior 
knowledge (such as the spectrum, in this example). 
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8. Here we take a waveform x(t) and explicitly replace it by sgn[x(f)]. Hence the auto¬ 
correlation of the clipped signal is the same as the <// coefficient of x(f) and x(t + r) as 
in Prob. 17.7. 

9. The following graph shows V(t) = cos f + cos et + cos vt from f = 0 to f = 150, plot¬ 
ted at intervals oft = 0.25. The general character is certainly reminiscent of low-pass noise. 
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The amplitude distribution of cos kt is P(V) = 77 “'(1 - V 2 )' l/2 n(V'/2) < regardless of k, 
and since the three terms are uncorrelated, we expect the sum of three such variables 
to have an amplitude distribution [P(V)]* 3 . The variance of P(V), given by 
V 2 = J' ] V 2 P(V)dV is 0.5. Hence, the variance of [P(V)]* 3 is 1.5. From the central 
limit theorem we might expect that [P(V)]* 3 is approximated by 
(2ir)~ 1/2 (1.5)“ ,/2 exp(-V 2 /3) = G(V), a curve which is shown above in lieu of [P(V)]* 3 , 
which is harder to calculate. The actual fraction of values of V(t) in each amplitude 
range is also shown. The agreement is reasonable, but clearly a longer sample of V(t) 
would be required before a distribution smooth enough to discriminate between G(V) 
and some different smooth curve would result. There are 59 upcrosses. From the vari¬ 
ance (27 t)~ 2 [(1 + e 2 + 7t 2 )/3] = 0.154 we expect (0.154) 1/2 = 0.392 upcrosses per unit of 
t, or a total of 59 in [0,150]. Thus in certain ways the waveform simulates random noise. 
The peculiar spectrum could easily be revealed even in the short sample shown, but 
of course random noise may have any spectrum. The waveform would fail any test of 
randomness that brought out the coherence in narrow bands around angular frequen¬ 
cies of 1, e or 7r. 

10. The real part of (V^ V 2 *) is given by time-averaging the product of the two instantaneous 
voltages, and the imaginary part is obtained by introducing a quarter-cycle phase shift 
between the two voltages before applying them to a second multiplier and integrator. 
Let F(l,m) be the field phasor in the direction ( l,m ) on a remote transverse plane. T(l,m), 
the temperature in the direction (/,m), is proportional to ( FF *). Let E(x/ A, y/A) be the as¬ 
sociated electric field distribution over the receiving plane, which is also transverse to 
the direction of the antenna beam. £ and F would be a two-dimensional Fourier trans¬ 
form pair if the fields were steady alternating fields, and they are in this case too, where 
F fluctuates with time, if allowance is made for propagation time by defining £ to be 
measured with a delay equal to the propagation time between the two planes. Thus 

£(x/A, y/A) cx j| F(l,m) e «riW+my/A) rfWm 
The spatial autocorrelation of E transforms into FF*; 

Jf £*(*'/A,y'/A)£(x'/A - x/A,y'/A - y/A)d(x'/A)d(y'/A) 
oc || F(l,m)F*{l,m)e + ^dldm. 

The expression on the left may be written where E x is the field with refer¬ 

ence to an origin which is movable with respect to E 2 , whose origin is fixed. (Think of 
an instantaneously frozen field pattern, displace it by an amount (x/A,y/ A) with respect 
to itself, multiply and integrate.) Time averaging both sides, 
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«E 1 E!) spaB ai> « ^{FF*} ex ^{T} = T. 

Under circumstances where the fields at different points in the receiving plane differ 
in detail but have the same statistics, which will be the case for a remote constant source, 
spatial averaging at an instant will give the same result as time averaging at one pair 
of points only. Hence the time averaging on the left-hand side is sufficient. Thus 

<EiE5> « T 


and if both sides are normalized to be zero at their origin 


I - 

r(*/A,y/A) = 


(EiE?) 

fcE?) 

(EiE?) 

(E,E?) 


T(0,0) 


11. The bandwidth A/ of the reception filter whose power-transfer function is exp( -p/7B 2 ) 
is given by A/ = \W RirR (p. 468). The equivalent width W R of exp(-/72B 2 ) is (27r) 1/2 B 
(p. 59). Since variances add under convolution (p. 190) W R * R = 2 1/2 W R and A/ = 1.77B. 
The integrating time of the smoothing filter is (27r) l/2 b~' (Table 17.1). Hence 


K = 


r.m.s. fluctuation 
mean deflection 


= (rA/)" 1/2 = (2 b/B) 1 ' 2 . 


With B = 10 4 Hz and b = 10 2 Hz, K — 0.14. The sensitivity would have to be 14 
times better to permit working to 1 percent. The integrating time (2v)~ x,2 b~ 1 is 4 milli¬ 
seconds. Since sensitivity improves as the square root of r it would be necessary to in¬ 
tegrate for 14 2 X 4 milliseconds = 0.8 seconds. To establish that a change had occurred, 
the change would have to amount to two or three times the r.m.s. error. This would 
take several seconds. 

Gain fluctuations of the order of 1 percent taking place in times shorter than a sec¬ 
ond could not be detected with the setup described (unless the fluctuations were sys¬ 
tematic over considerable times), and it might not be important to know about a phe¬ 
nomenon simulating the generated noise. However, such gain fluctuations might be 
deleterious for some purposes and could be revealed by comparison of three ampli¬ 
fiers fed from the same noise source or by use of a single-frequency signal generator. 


13. We are given that the spectrum is of the form S(/)FI(//2/ c ), but S(/) is not specified. 
The autocorrelation function (x(f)x(f + r)) is the Fourier transform of the power spec¬ 
trum SS*n(//2/ c ) and is therefore 

SS* * (2 f c sine 2/ c f). 

The question is whether this is zero at the sample interval 0.5 Now the function 
(2 f c sine 2 f c r) is itself zero at t — 0.5 f c , but if we convolve this function with some 
other function, the zero will in general shift. Therefore, in general, critical samples are 
correlated. 

The correlation will be zero if SS* — 6(f), i.e., if SS*(f) is a flat spectrum. 

The average spacing of effectively independent samples must be the reciprocal of 
the equivalent width of the autocorrelation of SS*U(J/2f c ) since the theory of pp. 
466-468 shows that this is the quantity whose square root controls the increase of pre¬ 
cision of noise power measurement. 
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14. Let the average field strength over an antenna aperture be E m , but let the field depart 
slightly from uniform by a fraction e which is a function of position in the (x,y)-plane. 
Then the field is (1 + e)E m . The power per unit solid angle launched in the forward di¬ 
rection is // (1 + e)E m (l + e*)E*,dxdy which falls below what would be launched on 
axis in the absence of errors by a factor 

aperture area 
jj(l + e)(l + €*)dxdy 

It is understood that the total radiated power is the same in both cases. If the errors e 
are entirely due to small wavefront corrugations of amount 6, there are no amplitude 
variations and e = i 8 and 

aperture area 1 

^ \\ (1 + [e\ 2 )dxdy 1 + < fi2 > 

where (8 2 ) = // 8 2 dxdy/( aperture area). 

If the aperture distribution is not uniform, even in the absence of errors, as is the 
case for a paraboloidal reflector (because the rim is further from the focus and in ad¬ 
dition is away from the beam maximum of the feedhom at the focus), we introduce 
the concept of directivity factor 25. For a paraboloid 2) has a value of about 0.6 and for 
a rectangular feedhom about 0.8- It represents the power reduction relative to an aper¬ 
ture area si of the same size that is excited uniformly. In this case the fractional de¬ 
parture from the mean is real and not particularly small and 

2) ------1- 

si -1 JJ (1 + e)(l + e*)dxdy * + Var e 

If now we perturb the excitation by introducing small corrugations that bring the to¬ 
tal errors to e', we have 

_ 1 + var e 
f " 1 + var e ' 

Putting e' = e + i8 we get 

_ 1 + var c 

1 + var e + var 8 

= 1 _ 1 

~ 1 + var 8 ~ 1 + 8 2 ' 

provided 8{x,y) does not correlate with e(x,y), i.e., var(e6) = 0. 

15. Let the N antennas be located at (x„,y„) where n ranges from 1 to N. Then the angular 
spectrum as a function of direction cosines (/, m) is (p. 418) 

N 

P{lsn) = N' 1 ^ e tt( ' x " +my ” ) 

n =i 

where the factor N -1 has the effect of normalizing so that P(0,0) = 1. We could now 
regard x„ and y n as random variables and treat P(l,m) as a sum of random variables 
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and use the central limit theorem. Alternatively, impose a fine square grid of M 2 lat¬ 
tice points on the area G. At any lattice point (x„y,) there is a probability N/M 2 of find¬ 
ing an antenna and a probability 1 — N/M 2 that there is none. If there were antennas 
excited with amplitude a, at each point we would have 

q-i m 5 

The present problem is one where a, has a probability distribution 
Pr(fl,) = (1 - N/M 2 ]S{a,) + (N/M 2 )8(a, - 1). 

Using angular brackets to represent ensemble averages 

(P(I,m)> = ( [ 2 «*] 1 2 " my,) ) 

The factor 2a, will fluctuate somewhat from arrangement to arrangement within the 
ensemble but will be equal to N on the average. Taking it outside the brackets and not¬ 
ing that (o,) = N/M 2 we get 

(P(l,m)) ~ N' 1 2 <a,y* ( '*' +ffly ' ) 

i=l 

M 2 

= M -2 2 e ik( - ,x,+mv ‘ i 

i=i 

This is precisely the pattern that would result if the area G were filled with antennas. 
In return for the advantage of achieving with N antennas the resolution associated with 
M 2 antennas the price paid is a reduction of sensitivity by a factor N/M 2 . 






CHAPTER 18: HEAT CONDUCTION AND DIFFUSION 

1. The differential equation governing the pouring together or confusion rather than the 
melting away or diffusion is obtained by changing the sign of t; thus 

tfV/dx 1 = -rc dV/dt. 

Whether one can obtain an earlier temperature distribution by convolution is rather 
an interesting question because convolution tends generally to broaden and smooth a 
distribution whereas here narrowing and sharpening would be required. In ordinary 
diffusion a transfer function exp(— 47r 2 fs 2 /rc) corresponding to low-pass filtering was 
applicable. Here it would be appropriate to use exp(47r 2 fs 2 /rc) which would have the 
effect of increasing high-pass filtering as we advance into the past. Any spatially Gauss 
ian component of the temperature distribution will then revert to a point deposit of 
heat a finite time before. Normally one would convert a transfer function to a corre¬ 
sponding function of x by taking the Fourier transform. There is a serious problem of 
conversion of the Fourier integral in this case, but it may be tackled, with practical re¬ 
sults, in the following way. Note that 

exp(4tr 2 fs 2 /rc) = 1 + 47r 2 fs 2 /rc + (47r 2 fs 2 /rc) 2 /2 + .... 
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Transforming term by term yields 

S(x) - (t/rc) S"(x) + (t/rc) 2 8 m (x) 

which would be the desired inverse convolving function. As a special case, if we wish 
to turn back the clock by only a small fraction of the time to the last deposit, only the 
first two terms count. Then we see that the present temperature distribution V(jc) is to 
be corrected by subtracting a small distribution that is proportional to the second de¬ 
rivative, since 

[S(x) - (t/rc)S"(x)] * V{x) = V{x) - (t/rc) V"(x). 

A few trials will soon reveal that we do indeed have here a convolution process that 
narrows and sharpens as desired. 

3. Equalization is the correction of transmission system distortion due to disturbance of 
the relative amplitudes and phases in the Fourier components of a signal waveform. 
The correction is made by an equalizing filter which might, for example, compensate 
for reduction of low frequencies in transmission by boosting them relative to higher 
frequencies. Reverse diffusion could be thought of as correction for distortion of a spa¬ 
tial temperature pattern due to lapse of time. The analogy is rather close in that the 
distortion of the pattern may be compensated by a simple operation on the spatial fre¬ 
quencies although in this case it is the high frequencies that are to be boosted. A fur¬ 
ther resemblance is that full restoration is limited in both cases by noise. Thus, a high 
spatial frequency component of a temperature distribution would rapidly become small 
in amplitude and would then require a large restoring factor; but it would be unwise 
to apply the large theoretical factor if the amplitude had fallen to the level of spatial 
noise, or measurement error, at that spatial frequency. Reverse diffusion differs from 
equalization in general in not requiring phase correction and in requiring only correc¬ 
tion factors of the form exp ks 2 . 

4. If one-centimeter radiation fell on the moon it would be partly reflected or scattered 
back and partly transmitted into the interior, where it would be absorbed in the first 
few centimeters or so depending on the local electrical conductivity and permittivity. 
Conversely, radiation escaping from the moon originates in a subsurface layer, suffer¬ 
ing attenuation appropriate to the depth of origin as it emerges. The intensity at the 
depth of origin is proportional to the temperature there. From p. 485, the depth of pen¬ 
etration d of a sinusoidal temperature variation at angular frequency o> is given by 
exp(-od) = 1/e where a = Rey = (cucr/2) 1/2 ; the lower frequencies penetrate more 
deeply. Consequently, below a certain depth into the moon, the temperature variation 
will be sinusoidal at the fundamental frequency because the harmonics will have died 
away. The emitted microwave radiation will be a weighted sum of contributions at fre¬ 
quency (o from a range of depths. The surface amplitude of the fundamental is in the 
neighborhood of 100 K but is modified at depth x by a factor exp( - yx). This not only 
produces a reduction factor exp(— ax) but a phase factor exp(— jfix). Since a = (3 in 
this case, there is a phase delay of one radian associated with each neper of reduction 
in amplitude. That is why the microwave full moon comes an eighth of a month late. 

5. In an electric circuit rI 7 /2 is always positive and its time integral, which represents the 
energy dissipated ohmically, is of necessity monotonic increasing. In heat conduction 
entropy is always monotonic increasing in a closed system. However, no analogy with 
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entropy can be found; for example, entropy may decrease at some places, but dissi¬ 
pated energy in a circuit cannot. Therefore, rl 2 interpreted as the product of thermal 
resistance per unit length and the square of heat flow has to possess some other sig¬ 
nificance. It certainly has the mathematical significance that applies to the time inte¬ 
gral of the square of any time varying quantity, but that does not possess any specifi¬ 
cally thermal significance. Likewise, the stored energy CV 2 /2 in a capacitor plays an 
important role in circuit theory, but thermal capacity times the square of temperature 
is not a working concept in the theory of heat conduction. (Example: When an un¬ 
charged capacitor C is connected across an identical capacitor charged to voltage V ini¬ 
tially containing energy CV 2 / 2 the voltage drops to V/2 and the energy now stored in 
the two capacitors is C(V/ 2) 2 /2 + C(V/2) 2 /2 which is only half the initial energy. This 
alerts us that no matter how heavy the connecting wire, half the energy is dissipated 
in it ohmically, even in the limit as its resistance approaches zero. This can be presented as 
a curious puzzle. However, in the thermal analogy, where a cold thin copper plate is 
applied face on to an identical hot plate, we understand that the temperature drops to 
the midvalue, and it is hard to present this behavior as puzzling even though the equa¬ 
tions are the same as in the electrical case.) 

6. The thermal capacitance of a segment dx of the bar is cdx, and if a quantity of heat dq 
enters the segment the temperature rise dV will be dq/cdx. Then by definition the in¬ 
crease in entropy of the segment will be cdx dV/V, and the increase in entropy if the 
temperature rises from V from an initial value T 0 to a value V t at time t will be 

\ V 'cdxdV/V = cdx ln(V,/V 0 ). 

The increase in entropy of the whole bar will be 

| ”“c In (V t /V 0 )dx = c | In Vj(x) dx - c j In VqM dx. 

The final integral depends on the initial situation but is constant with time. 

The integral JlnV,(r) dx is familiar in electrical transmission of images. In that in¬ 
terpretation x would be a two-component vector and V",, representing intensity, would 
be a scalar function of the vector variable. By analogy with thermodynamics this inte¬ 
gral is called the entropy of the image, but the resemblance is only superficial. A less 
misleading term would be "decibel integral." The term image entropy is also applied 
to fV In V dx (the reason is the resemblance to an expression f p In p dp that occurs in 
statistical mechanics). Needless to say, neither form of image "entropy" possesses pro¬ 
found properties such as increasing as time elapses. 

7. Since meteors move with velocities around 40 kilometers per second, the whole of a me¬ 
teor trail, which may be 10 kilometers long at a height of 80 kilometers, is formed very 
rapidly. We may imagine the trail of ionization created as diffusing cylindrically as time 
elapses. If the electron density N is to be a Gaussian function of r at each value of t, with 
width proportional to t 1/2 , then the peak density must diminish as i -1 if the number of 
electrons is to be preserved. (In one-dimensional diffusion this factor was f -1/2 .) 

The general diffusion equation (p. 475) is 

<1 2 N d 2 N d 2 N 1 8N 
dx 2 dy 1 dz 2 K dt 
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and under cylindrical symmetry this becomes 

1 S^N d 2 N 1 dV 
r 2 ae 2 + dz 2 - k dt ' 

Substituting N = (a/4-rrKt) exp(—r 2 /4/Cf) into this differential equation we verify that 
we have a solution. 

The refractive index is zero at frequency/in MHz when the electron density N per 
cubic meter is given by N = f 2 /81. To find the maximum value of r we could differ¬ 
entiate 4-nKN/a = f _1 exp(-r 2 /4Kt) with respect to t and set dr/dt — 0, but it saves 
a line or two to differentiate 47rKN/a — u exp(-r 2 «/4fC) with respect to u and set 
dr/dii = 0; thus 

0 — u(d/du)(—t 2 u/4K) exp( ) + exp( ) 

= -(u/4K)[r 2 + 2r(dr/du)u] exp() + exp(). 

Setting dr/du = 0 we get 0 = -ur 2 /4K + \ or 

i*/4Kt = 1. 

The maximum radius thus occurs at t - a/4ireKN and the maximum radius is 
(a/ireN) 1/2 in general or 

(81 a/iref 2 ) 1 / 2 = 3.0 7a^ 2 /f 

when N = f 2 )^ 1. 

The cylinder of zero refractive index shrinks to zero radius when the central elec¬ 
tron density a/4-jrKt falls to /*/81, i.e., when t = 6\a/4irKf 2 = 6.4a)Kf 2 . 

After that, the column of electrons ceases to act as a sharply bounded reflector but 
may continue to reflect by the mechanism of Prob. 18.8. 

8. All the electrons lying within a range R + x to R + x + dx from the radio transmit¬ 
ter, in number fN(r)dy, combine to produce an echo field strength proportional to 
exp[(i2fc(i? + x)]dx dy where the phase factor exp[(i2k(R + *)] allows for the total path 
length 2(R 4- x) and an amplitude factor depending on range has been absorbed into 
the constant of proportionality. Integrating over the values of x embracing the trail and 
taking the opportunity to absorb a phase factor exp(vkR) also we get the total echo 
field as proportional to JfN(r)exp(i2kx)dx dy. We recognize f N(r)dy = N A (x) as an Abel 
transform and the expression for the total field [N A (x)exp(i2kx)dx = T(k) as a one¬ 
dimensional Fourier transform. With k fixed we recognize this integral as one whose 
maximum value (p. 174) could reach fN A (x)dx — ffN(r)dx dy = a if all the electrons 
were confined to the axis. Consequently the power reduction factor, as the column ex¬ 
pands, is |a _1 //lV(r)exp(i2fct)dx dy\ 2 . The absorbed factors do not affect this conclusion. 

Now, since the wavenumber k is proportional to frequency we see that the Fourier 
transform T(k) is a transfer function describing the frequency response of the ionized 
column. Thus the quantity N A (x) may be regarded as the impulse response resulting 
from an incident impulse of electrical field. It gives the spatial waveform of the re¬ 
flected field. 

9. No strictly continuous system has been proposed but an analogue to the discrete cir¬ 
cuit of Fig. 18.8 can be set up. Imagine a drive shaft turning in a viscous medium that 
exerts a torsional resistance r per unit length. (The unit of rAx is unit torque per unit 
angular velocity.) Let the moment of inertia per unit length be l and the torsional com- 
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pliance per unit length be c. Then the equivalent circuit of length Ax would be as shown. 
Now connect an additional inertia to each segment by means of a differential gear 



rAx rAx 




inserted in the shaft as illustrated. Then the equivalent circuit would acquire an extra 
inductance L, where L equals the extra moment of inertia (referred to the shaft). The 
property of the differential is that 6 3 — 6 X — 0 2 - Now suppose that the shaft inertia is 
negligible (/Ax to « rAx), a condition that is met when the angular velocity is steady 
(ai = 0) or only slowly varying. 

In addition, let 

La) <5C 1/ojcAx 

which means that much more current flows through L than through cAx. In such cir¬ 
cumstances the combination of the two shunt elements is effectively an inductance. 
This new condition is similar to the first as both will be met for small enough w. Or, 
of course, we can suppose that torsional compliance is negligible. A series resistance 
shunt-inductance circuit then results, as in Fig. 18.8. There is a dual to the mechani¬ 
cal scheme (imagine a massive shaft of viscous nonelastic pitch suspended by spiral 
clocksprings). The impossibility of converting these systems to a continuous one is 
apparent, and it may be possible to prove that no such continuous torsional system 
can exist. 
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However, a continuous electrical system can be conceived in the form of a coaxial 
transmission line whose inductive reactance per unit length is negligible compared 
with the series resistance of the inner conductor. The shunt inductance is introduced 
by filling the line with plasma and operating at frequencies (well below the plasma fre¬ 
quency) so that the convection current carried between the conductors by free electrons 
dominates the displacement current associated with the capacitance between the con¬ 
ductors. 

13. (a) Sinusoidal response to sinusoidal excitation occurs in the presence of linearity plus 

time invariance. A few feet below the surface, only conductance can take place, so 
we need not take into account that heat transfer from surfaces by radiation is non¬ 
linear, and that heat removal by convection is complicated. Because the thermal re¬ 
sistivity and specific heat can be treated as constants (independent of temperature) 
over small ranges of temperature, nonlinearity should not be important. (One may 
note that the range of temperature variation is only moderate and that the tem¬ 
perature does not go down to the freezing point of water where significant changes 
in soil constants might be expected.) Time invariance is a separate question since 
it may very well happen that the soil is wet in winter and dry in summer, but in 
practice distortion of the annual sinusoid is hardly noticeable at depths of a few 
feet. 

(b) The characteristic thermal impedance Z 0 = (r/jioc) 1 ^ 2 has a phase angle of 45°. There¬ 
fore the heat flow lags the temperature variation by one-eight of a year. The 
temperature maximum comes one-eighth of a year after f = 0, so the heat flow 
maximum comes one-quarter of a year after t = 0, and is expressible by 
/(f) - I 0 cos(h)t - tt/2). Thus a = -v/2. 

(c) The diffusion equation 

d?6 d9 

dr 2 dt 

becomes, for sinusoidal time variation, 

d z 8 

where 6 is the temperature phasor (i.e., 8(t) = Re 6e' wl ). The solution 
9 — 0 o exp[— (j<orc)V 2 x] shows that the amplitude dies out with depth in propor¬ 
tion to o) 1/2 . So the diurnal variation does not penetrate very deeply and below that 
the simple annual variation predominates. 

14. Consider a drive shaft that transmits torque and angular motion. It is a continuous 
physical system and is one-dimensional in the sense that its state is adequately repre¬ 
sented by functions of x only, where x is distance along the shaft. A suitable pair of 
functions might be torque T(x) and angular velocity fl(r). Let the torsional compliance 
per unit length be c; this means that if a length dx is clamped at one end, then c dx is 
the ratio of angular displacement to applied torque. Let the torsional resistance per 
unit length be r(x); this means that if a steady torque exists on a free section of length 
dx then r dx is the ratio of that torque to the accompanying steady angular velocity. 
The drive shaft requires no further parameters to specify it (for example, it has no in¬ 
ertia). The equations arc: 

dT/dx = -ri l and dfl/dx = -cdT/dt. 
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Therefore, by eliminating O and T respectively, 

d 2 T /djc 2 = rcdT/dt and r^il/dx 2 = rcd(l/dt. 

Since inertia is zero, it might seem improbable that practical examples of inertia¬ 
less driveshafts could arise in practice, but in fact we do not require absence of mass, 
only that inertial impedance should be negligible compared with torsional resistance. 
Thus, if the moment of inertia per unit length is 1, we should be looking for situations 
where Ito <SC r. This condition is more than adequately met by steady rotation and may 
be complied with very well where angular velocity is only slowly varying. (Remem¬ 
ber that o) = 0 for fl = const, with time.) An example would be a drill turning in con¬ 
tact with the wall of its hole. The dual of this case would arise with a rotating shaft 
where inertia was important, but there was no external friction and negligible torsional 
stiffness. The second parameter would be viscous torsional conductance. (Picture a 
glassblower spinning a vase on the end of an overheated white-hot glass tube, so hot 
that viscous angular flow dominates torsional elastic deflection.) 

15. Consider a vertical column of cross-section area A. Then the thermal resistance per me¬ 
ter to vertical flow of heat is given by r = 1/kA thohms per meter, and the thermal ca¬ 
pacitance per meter is given by c = psA tharads per meter (p. 476). If x is measured 
downward from the surface and the surface temperature phasor is V(0) then the sub¬ 
surface temperature V(x) is given by V(x) — V(0) exp{— yx), where the propagation con¬ 
stant y = (zwcr) 1/2 and e> is the angular frequency to which the phasor refers (p. 485). 
Splitting the propagation constant into an attenuation constant a and a phase constant 
P we have y = nr + i(3 = (otcr/l) 1 ^ 2 + /(axr/2) 1 / 2 and V(r) = exp(— ar) V(0) expi/3. 
The attenuation factor in this case where x = 1 m, at — 27t/ 86,400 rad s' 1 and 
rc = ps/k = 2.1 X 10 6 s m -2 is given by exp(-ox) = exp [-(cucr/2) 1/2 ] = exp (-8.5) = 
2 X 10 -4 . Thus the 24-hour component of the surface temperature variation is reduced 
by 8.5 nepers, a factor of 2 X 10 4 (and since a = f3, its phase is retarded by 8.5 radi¬ 
ans or nearly 33 hours). The surface temperature does not vary sinusoidally but pos¬ 
sesses harmonics. They will be attenuated even more, so that the temperature one me¬ 
ter down will be very much more sinusoidal. It would seem that one meter is much 
deeper than necessary for many practical purposes. For the annual temperature vari¬ 
ation the attenuation factor is exp(-8.5/365 ,/2 ) = exp(-0.45) = 0.64, so the seasonal 
variation is not much reduced and the lag is 0.64 radians or approximately one month. 


CHAPTER 19: DYNAMIC SPECTRA AND WAVELETS 

3. An expression meeting the description is 

(f - f 2 ) cos(200f + 400t 2 - 267P). 

4. (a) The velocity of approach is v = —gl, taking t = 0 to be the moment when the train 
halts. The doppler shifted frequency is 550 + 550(u/c) = 550(1 - gt/c), where c is the 
speed of sound. Integrate to get the corresponding phase 550(t - gf/2c). Hence 
s(f) = cos[550(f - gf/2c)]. 

5. (a) The mean frequency is zero, as for all real signals, (b) The standard deviation is 
analogous to the radius of gyration of the line mass corresponding to 
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|S(/)| 2 = 0.5 x io-5 e -' r [ lo5 (/+6°)F + 0 5 x 10 -5 e - w [io 5 (/-60)p andf for guch a narrow-band 
signal, is close to 60 Hz. The exact value is [60 2 + (10 -5 /Z5066) 2 ] 1/2 . The factor 2.5066 
is the ratio of equivalent width to standard deviation. 


6. Since the first zero crossing is at t = 2.405/27T, the lowest frequency to be dealt with 
might be judged to correspond to a period 4 times 2.405/27r or 0.65 Hz. A choice of 
A/ = 0.08 Hz and At — 1 s might be a good combination to start with. However, the 
lengthening of period that is apparent to the eye from a graph of J u (27rf), and could be 
supported by a table of intervals between zero crossings, is not demonstrable on a ( t,f) 
diagram. The figure, due to David Choi, does show a reduction of amplitude as time 
elapses, as expected. 



Time (seconds) 


7. The Haar wavelet may be expressed in terms of two rectangle functions, but may also 
be expressed as -rect x sgn x shifted half a unit right. The transform of —rect x sgn x 
is -sines * (~i/ns), a convolution representing the Hilbert transform of -/sines, 
which is known to be i(7rs) _1 (l - cos 7rs). Allow for the right shift by multiplication 
with exp(—J7rs) to get F(s) — (7rs)“ 1 (l — cos 7rs)(sin tts + /cos 7rs). 



[ 22 M 

Pictorial Dictionary of Fourier 

Transforms 


Throughout the following table of Fourier transform pairs a function of x is on 
the left, and on the right is the minus-z Fourier transform, a function of s given by 

[ f(x)e~' 2lTSX dx. 

J -oo 

Small ticks show where the variables have a value of unity, imaginary quan¬ 
tities are shown by broken or thin lines, and impulses are shown by arrows of a 
length equal to the strength of the impulse. 

Most of the functions /(f) presented have either even or odd symmetry, partly 
because of the inconvenience of representing a spectrum that is complex by two 
curves, one for the real part and one for the imaginary. Consequently, most of the 
Fourier transforms are also Hartley transforms. Some Hartley transforms H(s) of 
unsymmetrical functions are given at the end; additional examples can easily be 
generated from a given Fourier transform F(s) = Sft(s) + z'I(s) using H(s) = 
0t(s) — X(s). In these cases, all of the information about the spectrum is contained 
in just the one curve. 

This pictorial dictionary, which contains the most frequently encountered 
transform pairs, is useful for finding the transform of a function, whether it is 
given graphically or analytically. There are, of course, many transforms that are 
uncommon, and it is necessary to search for these in tables. 1 

There are a number of other uses for this pictorial dictionary, such as check¬ 
ing numerical values in calculations and browsing through it for inspiration. One 
can also practice transforms by verifying that F( 0) equals the area under f(x) and/ 


1 G. A. Campbell and R. M. Foster, Fourier Integrals for Practical Application, John Wiley & Sons, New 
York, 1948; A. Erdelyi (ed.). Tables of Integral Transforms, McGraw-Hill Book Company, New York, 1954. 
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or that /(0) equals the area under F(s), at least approximately. If this quick test is 
passed, there may still be a sign error; check this by comparing the sign of the 
first moment of f(x) with the slope of F(s) at the origin; the signs should be op¬ 
posite. Corresponding checks may also be applied to transform pairs generated 
from discrete samples; when a packaged program is first used such checks are es¬ 
sential to make sure that the sampling intervals Ax and As are compatible, to as¬ 
certain whether it is the direct or inverse transform, if either, that has a multiplier 
N -1 , to see what convention has been followed regarding 27r, and to check that 
it is the direct transform that uses —i. 
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sinc 2 s 

ITS 


\ ni(s) [sinc(s +j) 
+ sinc(s-j)] 
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jCOS 7TXn(x) + jFI(x) 


j sinc(s 
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Re = (775 sin 2-n-s - sin 2 tts)/2tts^ 

*n(* --) Im = (7rs cos 27 ts -1 sin 2tts)/2tts 2 
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Circular 

envelope 


= / 1 (2tis)/2s 
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m 

HARTLEY TRANSFORMS OF SOME FUNCTIONS WITHOUT SYMMETRY 




8(x + 3) + S(x + 2) + 8{x -1) + S(x - 3) 


2cos 67 ts + cas (-4irs) + cas 2tts 
where cas s = cos s + sin s 
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2 sin 2ws - sin 4 ns 
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The Life of Joseph Fourier 


baron Jean-Baptiste-Joseph Fourier (March 21,1768-May 16,1830), bom in poor 
circumstances in Auxerre, introduced the idea that an arbitrary function, even one 
defined by different analytic expressions in adjacent segments of its range (such 
as a staircase waveform), could nevertheless be represented by a single analytic 
expression. This idea encountered resistance at the time but has proved to be cen¬ 
tral to many later developments in mathematics, science, and engineering. It is at 
the heart of the electrical engineering curriculum today. Fourier came upon his 
idea in connection with the problem of the flow of heat in solid bodies, includ¬ 
ing the earth. 

The formula 

\x = sin x — | sin 2x + 3 sin 3x + ... 

was published by Leonhard Euler (1707-1783) before Fourier's work began, so 
you might like to ponder the question why Euler did not receive the credit for 
Fourier's series. 

Fourier was obsessed with heat, keeping his rooms uncomfortably hot for vis¬ 
itors, while also wearing a heavy coat himself. Some traced this eccentricity back 
to his 3 years in Egypt, where he went in 1798 with the 165 savants on Napoleon's 
expedition to civilize the country. 

Prior to the expedition Fourier was a simple professor of mathematics, but he 
now assumed administrative duties as secretary of the Institut d'Egypte, a scien¬ 
tific body that met in the harem of the palace of the Beys. Fourier worked on the 
theory of equations at this time but his competence at administration led to po¬ 
litical and diplomatic assignments that he also discharged with success. It should 
be recalled that the ambitious studies in geography, archaeology, medicine, agri¬ 
culture, natural history, and so on, were being carried out at a time when Napoleon 
was fighting Syrians in Palestine, repelling Turkish invasions, hunting Murad Bey, 
the elusive Mameluke chief, and all this without support of his fleet, which had 
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been obliterated by Nelson at the Battle of the Nile immediately after the disem¬ 
barkation. 

Shortly before the military capitulation in 1801, the French scientists put to 
sea but were promptly captured with all their records by Sidney Smith, com¬ 
mander of the British fleet. However, in accordance with the gentlemanly spirit 
of those days. Smith put the men ashore, retained the documents and collections 
for safekeeping, and ultimately delivered the material to Paris in person, except 
for the Rosetta stone, key to Egyptian hieroglyphics, which stands today in the 
British Museum memorializing both Napoleon's launching of Egyptology and his 
military failure. 

The English physicist Thomas Young (1773-1829), father of linearity, is well 
known for establishing the transverse wave nature of light, explaining polariza¬ 
tion, and also for introducing the double pinhole interferometer, which exhibits 
the Fourier analysis of an optical object. Less well known is that he shared an in¬ 
terest in Egyptology with Fourier: he worked on the Rosetta stone, explained the 
demotic and hieratic scripts as descended from hieroglyphic writing, and isolated 
and identified consonantal signs. 

Fourier was appointed as Prefect of Isere by Napoleon in 1802 after a brief 
return to his former position as Professor of Analysis at the Ecole Poly technique 
in Paris. His duties in Grenoble included taxation, military recruiting, enforcing 
laws, and carrying out instructions from Paris and writing reports. He soothed 
the wounds remaining from the Revolution of 1789, drained 80,000 km 2 of malar¬ 
ial swamps, and built the French section of the road to Torino. 

By 1807, despite official duties, Fourier had written down his theory of heat 
conduction, which depended on the essential idea of analyzing the temperature 
distribution into spatially sinusoidal components; but doubts expressed by 
Laplace and Lagrange hindered publication. Criticisms were also made by Biot 
and Poisson. Even so, the Lnstitut set the propagation of heat in solid bodies as 
the topic for the prize in mathematics for 1811, and the prize was granted to 
Fourier but with a citation mentioning lack of generality and rigor. The fact that 
publication was then further delayed until 1815 can be seen as an indication of 
the deep uneasiness about Fourier analysis that was felt by the great mathemati¬ 
cians of the day. 

It is true that the one-dimensional distribution of heat in a straight bar would 
require a Fourier integral for its correct expression. Fourier avoided this compli¬ 
cation by considering heat flow in a ring, that is, a bar that has been bent into a 
circle. In this way, the temperature distribution is forced to be spatially periodic. 
There is essentially no loss of generality because the circumference of the ring can 
be supposed larger than the greatest distance that could be of physical interest on 
a straight bar conducting heat. This idea of Fourier remains familiar as one of the 
textbook methods of approaching the Fourier integral as a limit, starting from a 
Fourier series representation. 

Fourier was placed in a tricky position in 1814, when Napoleon abdicated and 
set out for Elba with every likelihood of passing southward through Grenoble, on 
what has come to be known today as the Route Napoleon. To greet his old mas- 
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ter would jeopardize his standing with the new king, Louis XVIII, who in any 
case might not look favorably on old associates and appointees of the departing 
emperor. Fourier influenced the choice of a changed route and kept his job. But 
the next year Napoleon reappeared in France, this time marching north through 
Grenoble where he fired Fourier, who had made himself scarce. Nevertheless, 
three days later Fourier was appointed Prefect of the Rhone at Lyons, thus sur¬ 
viving two changes of regime. Of course, only 100 days elapsed before the king 
was back in control and Napoleon was on his way to the south Atlantic, never to 
return. Fourier's days in provincial government then ended and he moved to Paris 
to enter a life of science and scientific administration, being elected to the 
Academie des Sciences in 1817, to the position of permanent secretary in 1823, 
and to the Academie Fran^aise in 1826. He never married. 

At the beginning mention was made of Euler's formula. The formula is cor¬ 
rect for — 7r < x < 77 but not for other ranges of x. The RHS is the Fourier series 
for the sawtooth periodic function (x/ 2 )n(x/ 27 r) * (2ir)' l Hl(x/2ir). Fourier wrote, 
around 1808-1809, "The equation is no longer true when the value of x is between 
77 and 277. However, the second side of the equation is still a convergent series 
but the sum is not equal to x/2. Euler, who knew this equation, gave it without 
comment." (Quotation from J. Herivel, Joseph Fourier, the Man and the Physicist, 
Clarendon Press, Oxford, 1975, p. 319.) 
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Convolution (Cont-): 
in two dimensions, 53, 290, 291, 331 
variance of, 191 
Convolution theorem 
for DFT, 269, 290 
and diffusion, 481 -482 
and Fourier series, 238 
for Fourier transform, 115-119,129-130, 332 
for Hankel transform, 339 
for Hartley transform, 298-299, 320 
in heat conduction, 481-482 
for Hilbert transform, 359, 372 
for Laplace transform, 385 
and spectroheliograph, 402 
in statistics, 434-435 
for waveforms and spectra, 206 
for z transform, 351 
Cooley, J. W., 141, 149, 275, 289 
Cooley-Tukey Algorithm, 141, 275 
Cornu spiral, 20, 546 
Correlation coefficient, 45, 46, 455, 470 
Correlation diagrams, 452-456 
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summary, 189 

waveforms and spectra, 198-200, 206 
COSFT algorithm, 302 
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Cosine transform 
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exercise, 150 

and Hankel's theorem, 340 
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Cotangent, 401, 533, 587 
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Covariance, 453. See also Autocovariance 
Critical damping, 28, 468 
Critical sampling, 223-224 
Critical spacing, 143,144,149 
Cross correlation, 46-47, 270, 282 
exercise, 51 

in two dimensions, 331 
Cumulant, 556 

Cumulative frequency distribution, 428 
Cumulative spectrum, 47-48 
Cusp, at the origin, 157,188 
Cutoff frequency, 66-67, 221 
Cutoff transform, 220-221, 329, 357 
Cycle of transforms, 329, 357, 376, 377 
Cycles per unit, 18, 19 
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Cyclic convolution, 264-265, 289-290, 292 
Cygnus A, 446, 447 


D'Addario, L. R., 403 
Dashed line notation, 68 
Data 
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density, 143, 144 
digital filtering, 299, 320 
sampling, 82, 347 
Daubechies, 1., 500, 505 
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DCT, 328. 502 

DCT1 and DCT2, 301-304 
Deans, S. R-, 329, 358, 371 
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Deconvolution, 34, 54 
exercises, 51, 250 
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derivation, 152—153 
for I lankel transform, 339 
for two-dimensional Fourier transform, 333 
for waveforms and spectra, 206 
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Degrees of freedom, 140 
Delta function, 70, 74. See also Impulse symbol 
notation, 103, 104, 126-127 
sifting property, 102 
Depth, of modulation, 207 
Derivative 
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Fourier transform, 124-125, 126, 333 
of fractional Fourier transform, 369 
of Gaussian function, 60 
half-order, 127, 351, 487 
of impulse, 85-87, 126 
Laplace transform of, 386 
for Mellin transform, 346 
of segmented function, 145 
of unit step function, 72 
Derivative theorem 

of convolution integral, 126-127, 130 
for Fourier transform, 124-125, 130,145 
and Laplace transform, 385 
for Mellin transform, 346 
Detection, of noise waveform, 466, 473 
DFT, 258 

definition, 260, 264 
examples, 265 
inverse, 261, 264 
leakage, 280 

packing theorem, 271, 290 
truncation error, 253, 280 


DFT (Conf.): 
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DHT. See Discrete Hartley transform 
dht If.tl), 291-292 
Dielectric loss, 479 
Differential equations 
with constant coefficients, 385, 393, 396 
in intial value problems, 392, 396 
Schrodinger's, 370 
Differentiation theorem 
for Fourier transform, 332 
for Hankel transform, 339 
for Laplace transform, 385 
for waveforms and spectra, 206 
Diffraction 

antenna analogy, 419-420 

Fraunhofer, 66, 368 

Fresnel, 171, 420-421 

optical and radio, 406 

problem solutions, 545 

three dimensional, 375 

in two dimensions, 92, 374, 377, 417-419 

X-ray, 340, 375 

Diffraction gratings, 82,147, 148 
Diffusion 

cylindrical, 486-487 
exercise, 487 
Gaussian, 480-481 
notation, 479 

of a spatial sinusoid, 481-485 
spherical, 487 
in two dimensions, 426 
versus wave propagation, 476 
Diffusion equation, 475-480, 481 
Digital data compression, 303-304 
Digital filtering, 299, 320 
Digital signals 
autocorrelation, 471 
and linear filter theory, 203, 218 
and sampling theorem, 219 
and spectrograms, 492-493 
Dilation equation, 506 
Dipoles, 85, 92 
Dirac, P. A. M., 74-75 
Direct current, 170, 198 
Direction cosines, 417-418 
Dirichlet, P. G. L., 236 
Dirichlet's discontinuous factor, 57 
Discontinuity. See also Gibbs phenomenon; 

Impulse symbol 
and central-limit theorem, 190 
fractional-order, 165 
infinite, at the origin, 139 
and large slope in short interval, 174 
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Discontinuity ( Cont .): 
of sign function (sgn x), 65 
and smoothness, 160 
unit step function, 61 

Discrete cosine transforms (DCT), 301-304, 
306, 327-328 

Discrete Fourier transform (DFT). see also DFT 
accuracy, 280-281 
applications, 281 
autocorrelation, 263-264, 270 
checking numerically, 328 
and convolution, 269, 282 
cross-correlation, 270 
from DHT, 295-296 
error causes, 280-281 
examples, 265-266, 272 
factorization, 317 
FFT, 275 

first value, 270-271 
formula, 258-264 

and Fourier transform, 262-263, 288, 291 

Hermitian property, 298 

inverse, 261-262, 263 

MATLAB examples, 272-275 

reversal property, 268 

sum of sequence, 270 

theorems, 266-272 

timing, 282 

two-dimensional, 284-285, 290 
Discrete frequency, 260-261 
Discrete Hartley transform (DHT) 
checking numerically, 328 
computing, 305 
of a convolution, 320 
convolution using, 298-299, 320 
examples, 297-298 
fast algorithm, 309, 322 
and Hilbert transform, 366-367 
matrix formulation, 317 
notation, 294 
theorems, 300-301 
timing, 314 

in two dimensions, 299-300 
Discrete samples, 219-220, 258 
Discrete-time signals, 203, 204-205, 218 
Distribution function, 428 
of a sum, 429 

Distributions, see also Generalized function 
of amplitude, 450-455 
multidimensional, 89-92 
normal error, with zero mean, 58 
of size, 437-438 
of a sum, 429-433 
truncated exponential, 436-438 


Distributive law, 27 
Doetsch, G., 22, 151, 190, 381, 398 
Dorsch, R. G., 370, 371 
Drift reduction, 204 
Driving function, 392 
Drunkard's walk, 60 
Duhamel integral, 24 
Duplicating property, 84 
Duplicating symbol, 128 
Duration, 170-173 
Dynamic power spectra, 492 
computing, 494 


E(x), 27 
Ear, 489-490 
Echoes, 20, 54 
Elastic capacitor, 213 
Electric charge distributions, 91-92 
Electric circuits, 396-397 
Electrical current 
alternating, 92,198, 359 
direct, 170,198 
Electrocardiograms, 491 
Electromagnetic radiator, 92 
Electromagnetics, 148, 203 
Electrostatics, 85 

Elementary chirp signals (chirplets) 
frequency division, 494 
interactive presentation, 502 
spectrograph, 491 
time division, 496 
Elliot, D. F., 283-284, 289 
End-fire arrays, 407 
Energy 
infinite, 9 

and Laplace transform, 389, 392-396 
and power theorem, 120-122 
stored, 392 

Energy spectrum, 47-48 
Energy theorem, 127, 206. See also Power the¬ 
orem 

Entropy, 478, 486 
of image, 567 
Envelope 

of bandpass noise, 465-466 
and dynamic power spectra, 408-409 
Gaussian, 247 
of a signal, 363 
Envelope function, 116 
Epoch, 155 

Equalization, 486, 566 
Equivalence theorem, 497-498 
Equivalent width, 164, 189 
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Equivalent width (Cant.): 
and beamwidth, 167 
of distributions, 166 
of function, 166,167 
of functions, 166 
of Gaussian function, 59 
for Hankel transform, 339 
reciprocal property, 167 
in spectroscopy, 165 

for two-dimensional Fourier transform, 333 
of various functions, 168-169 
of waveforms and spectra, 206 
Erdelyi A., 22, 329, 371, 381, 398 , 573 
Erdelyi's tables, 301 
Erf, 58-59 
Error integral, 58 
Errors 

in convolution examples, 29 
in discrete Fourier transform, 280-281 
and precision, 140-141 
in sampling, 234-235 
sign, 142 

Ersoy, O. K., 289, 324 
Euler, L., 236, 256, 594, 596 
Evanescent fields, 410, 418, 421 
Evans, D. M., 289, 323, 325 
Even function, 13, 266 

transform of, 13, 15, 266-267 
Even impulse pair, 2-3, 70, 84 
Eye, 424, 447, 553 


Fabry-Perot interferometers, 147 
T, 7, 8, 367 
Faltung, 24, 26, 27 

Fast Fourier transform (FFT). See also Cooley- 
Tukey algorithm; FFT 
applications, 281-282 
and critical spacing, 149 
factorization of transform matrix, 275-276 
versus FHT, 305, 315 
and permutation, 321 
power spectra, 285-288 
practical considerations, 278-280 
and shift theorem, 276 
and stretching theorem, 276 
and 365 data values, 283-284 
timing, 283, 292 
Fast Hartley transform (FHT) 
algorithm, 309-314 
versus FFT, 308-309, 315 
matrix formulation, 317-320 
subroutine, 322-324 
timing, 308, 314-317 


FFT, 141, 275, 281. see also Fast Fourier trans¬ 
form 

££t< >,272-273,284 
FHT. See Fast Hartley transform 
Filtering, numerical, 224, 225 
Filters, 198 
analogue, 250, 495 
analogy with antennas, 416 
bandpass, 250-251, 494 
characteristic waveform, 201-202 
constant-Q, 501-502 
definition, 200 
digital, 299 
fixed-frequency, 147 
general, 251 

and Hilbert transform, 359 
low-pass, 66, 75 
measuring, 167 
of noise, 45-46,171 

and random input, 450-455, 462, 466, 473 

reception, 468 

rectangular, 224-226, 227 

smoothing, 468 

time-invariant, 39 

Finite difference, 84, 180-184, 189, 206 
as convolution, 33, 84-85 
Fourier transform of, 182 
for Laplace transform, 385 
in two dimensions, 333 
Finite Fourier transform, 217, 242-243 
Finite impulse response (FIR), 204 
Finite resolution, 93 
Finite transforms, 242-243 
First difference theorem, 301 
First moment, 153-156, 189 
and Mellin transform, 344 
in two dimensions, 333 
of waveform, 206 
Fixed-frequency filters, 147 
Flanagan, J. L., 493, 506 
Flannery, B. P., 21, 141, 149, 289, 302, 304, 
321, 325 

Flow diagram, 278, 311 
Flow/pressure, 203 
Focus, 369 

Formula interpretation, 18-20 
FORTRAN, 142, 149, 323 
FORTRAN 90,141, 142 
Forward difference, 33 
Foster, R. M., 21, 573 
Fourier, J. B. J., 55, 236 
biography, 594-596 
Fourier kernels, 329, 339-340, 346-347 
Fourier series 
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Fourier series ( Cont .): 
convergence, 57 
double, 91 

as extreme case of transform, 237 
and Gibbs phonomenon, 240, 250 
and sampling, 235, 237, 256 
and shah, 82, 83, 247-248 
Fourier transform, see also Abel-Fourier-Han- 
kel ring; Discrete Fourier transform; Fast 
Fourier transform; Fractional Fourier 
transform; Slow Fourier transform 
of Abel transform, 373 
applications, 370, 405 
of autocorrelation function, 122 
conditions for existence, 8-10 
and convolution theorem, 115-119 
definition, 5-6 
of derivative, 124 
eigenfunctions, 194, 196, 514 
examples, 134, 369 
finite, 217, 242-243 
of Gaussian function, 58,105 
of generalized function, 127 
half-order, 367 

and Hartley transform, 293-295, 306-307 
of Hilbert transform, 360 
and Laplace transform, 22, 381 
notation, 7 

of null functions, 87-88 
numerical, 140-142 
of point response function, 416 
of product, 117 

reciprocal properties, 18-20,194, 266 
recovery of original function, 326 
and sampling, 82, 230 
and Schrodinger's equation, 197 
of sine 2 , 67-68 
slow, 136,142 

software packages, 141-142 
spectroscopy, 148 
symmetry properties, 15 
tables, 107, 130 
theorems, 130, 332-333 
in three dimensions, 340-343, 375, 378 
in two dimensions, 284, 329-331, 332-335 
exercises, 374, 375, 377 
Fourier's integral theorem, 6, 21-22 
Fourpole. see Filters 
Four-terminal network, 200 
Fractional convolution, 369 
Fractional Fourier transform, 367-370, 505 
Fractional order derivatives, 127, 351, 353 
Fraunhofer diffraction, 66, 420 
Frequency analysis, 135, 305, 489 
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Frequency division, 494-495 
Frequency response, 3, 200 
Fresnel diffraction, 171, 420-421 
Friedman, B., 93, 99 
Friis, H., 423 
Fringe visibility, 416 
Functional, 3, 25 


Gabor, Dennis, 490, 499,501, 502, 505 
Galvanometers, 28 
Gardner, W. A., 428, 442, 447, 469 
Gaskill, J. D„ 422 
Gate function, 2, 57 
Fourier transform of, 105, 137 
Hilbert transform of, 365 
Laplace transform of, 388 
Gauss, C. F., 141 

Gaussian amplitude distribution, 463 
Gaussian diffusion, 480 
Gaussian envelope, 247 
Gaussian function, 58, 575 
and central-limit theorem, 186-188 
derivatives, 60 
double humped, 218, 531 
Fourier transform of, 139 
and frequency, 435 
and heat, 480-481 
and noise, 463, 464-465 
and pulse shape, 75, 77-78 
table of, 508 
transform of, 105 
in two dimensions, 59 
Gaussian functions, 412 
Generalized function, 4, 75 
concept, 92-94 
derivative, 97 
exercise, 103 

Fourier transform, 127-128 
as ordinary function, 98 
product, 128 
transform, 98 
Geophysics, xvii 
George, N., 372 
Gertner, I., 289 

Gibbs phenomenon, 81,240-242, 250 
Gold, B„ 2 89 
Good, I. J., 275, 289 
Goodman, J. W., 21, 422, 422, 447, 469 
Graded refractive index, 368, 379 
Graphical representation 
of functions, 55 
of imaginary quantities, 68 
of impulse symbol, 80 
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Graphics, 129, 251-252 
Gratings, 82,147, 148 
Gravity, center of 
and centroid, 155 
and convolution theorem, 118 
for two-dimensional Fourier transform, 333 
for waveforms and spectra, 206 
Gray, R. M„ 21, 428, 442, 469 
Grebenkemper, C. }., 403 
Green's function, 4, 481. See also Impulse re¬ 
sponse 

Griffiths ,}., 422 
Grossman, A., 500, 506 
Group theory, 367 
G-string, 489 
Guo, H., 308, 325 
Gyration, radius of, 159, 344 


Half-order derivative, 127, 351, 487 
Half-power, width to, 167 
Hankel transform, 335-339, 343, 357. See also 
Abel-Fourier-Hankel ring 
exercise, 376 
in n dimensions, 343 
Hao, H„ 300, 325 
Harmonic response, 3, 39, 209 
Harmonics, 255 

Hartley, R. V. L., xix, 200, 211, 293, 296-297, 
325 

Hartley oscillator, 296-297 
Hartley transform, 142, 147, 293, 573. See also 
Discrete Hartley transform; Fast Hartley 
transform 

complex, 306-307, 327 
convolution theorem, 298—300, 320 
decomposition formula, 310 
discrete (DHT), 293 
factorization, 317 
fast (FHT), 308, 322 
and Fourier transform, 144, 306-307 
instrumentation, 147 
intensity, 337 
matrix formulation, 317 
microwave, 307 
numerical example, 314 
optical, 307 
physical aspect, 307 
power spectrum, 314 
and spectral analysis, 493 
theorems, 298, 300-301, 310, 375-376 
in two dimensions, 299-300 
Haus, H. A., 423 
Haykin, S., 503, 506 


Heat conduction 

diffusion along a poker, 477 
Fourier's theory, 475, 595 
Green's function, 481 
irreversibility, 476 

one-dimensional diffusion, 475-480 
point concentration, 480 
problems, 485 

spatial sinusoid diffusion, 481-485 
thermal-electric analogy, 487 
Heaviside, O., 74, 381 
Heaviside step function, 61-65, 70, 265 
Fourier transform. See Pictorial 
Dictionary 

Fourier transform of, 583 
Laplace transform of, 388 
Helicoid, 113 
Helix, 362 

Helliwell, R. A., 370, 371, 493, 506 
Helmholtz, H. von, 74 
Herivel, ]., 596 

Hermite-Gauss functions, 194, 575 
Hermite polynomial pairs, 194, 197 
Hermitian, 14,191, 298 
autocorrelation, 50, 51 
characteristic, 435-436 
exercises, 373 
transfer, 373 

Hermitian spectrum, 199 
Heydt, G. T„ 2 11, 297, 308 
Hilbert transform, 329 
analytic signal, 361 
causality, 363 
computing, 364-367 
definition, 359 
envelope, 363 
Fourier transform of, 359 
instantaneous frequency, 363, 493 
instantaneous phase, 498 
of noise, 465-466 
phasor generalization, 361 
tables, 365 
theorems, 372 
Hilgevoord, J., 190 
Histograms 

distribution of sum, 429 
noise amplitude, 448 
Poisson distribution, 441 
Hobson, E. W., 55 
Hou, H. S„ 314, 325 
Humbert, P., 22 
Huygens, C., 408 

Huyghens' principle, 408, 416, 417 
Hydrology, 253 
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Impedance, 485 

Improper function, 74-75. sec also Impulse 
symbol 

Impulse response 
continuous-time, 205 
convenience, 74 
in digital filtering, 204 
exercises, 216-217 
for fictitious impulse, 4 
of filter, 200-204 
Fourier transform, 200-201 
Laplace transform, 381, 390-392 
rectangular, 216 
transfer function, 390-392 
Impulse symbol, 8(x), 4, 74 
causal, 519 

derivatives, 85-87, 97, 126 
duplication, 84 
in electrical networks, 74-75 
and finite resolution, 93 
Fourier transform of, 106 
as generalized function, 92, 95 
graphical representation, 80 
Laplace transform of, 388 
notation, 4, 85 
and null functions, 87-88 
pairs, 84,154, 414 
problems, 99, 517 
product, 103, 431 
in proofs of theorems, 128 
properties, 80-81 
and pulse shape, 75, 79 
replicating property, 83-84 
ring impulse, 104, 338 
sampling property, 81-83 
sifting property, 78-81, 86 
two-dimensional, 334, 375, 377 
and unit step function, 75-78 
utility, 80, 92 
Impulse train, 365, 401 
periodic, 245-246 
IMSL, 142, 149 
Independence, 451-454 
Index replacement rule, 274 
Index reversal, 291 
Inequalities, 174-176, 206 
Bessel's, 176 
limits 

to autocorrelation, 49 
to ordinate and slope, 174-176 
Schwarz's, 49,176,178,189 
for waveforms and spectra, 206 
Inertia, 156-157 
Infinite impulse train, 2 


Infinitesimal dipole, 85 
Information loss, 45, 47 
Infrared, 486 

Initial-value problems, 392-396 
Instantaneous frequency, 363, 374 
Integral 

as convolution, 63 
Laplace transform of, 385 
Integration in closed form, 137-140 
Integration theorem 
for Laplace transform, 385, 387 
Interferometer, 471 
and autocorrelation, 45 
and Hartley transform, 307 
and modulation theorem, 414-415 
nulling, 427 
problems, 4Z5, 426, 427 
radio, 416 

and spectra measurement, 147 
Interlaced sampling, 232-234, 235 
exercises, 250, 251 
Interpolation, 65-68 
exercises, 249, 252-253 
Lagrange, 253 
midpoint, 224, 225, 290 
and sampling, 252-254 
sine function, 292 
symbol, 70 

Inverse sampling theorem, 256 
Inverse sequence, 34, 37 
problems, 51, 250 
Inverse smoothing, 163 
Inverse transform notation, 7-8 
Inversion 

Abel transform, 355 
of convolution, 34, 269, 413, 485 
problems, 51, 54, 250 
of DHT, 295-296, 298 
finite Fourier transform, 242 
Fourier transform, 6 
three-dimensional, 340 
two-dimensional, 329-330 
Hankel transform, 336 
Hilbert transform, 359 
Laplace transform, 349, 381 
Mellin transform, 343, 349 
Radon transform, 358 
serial multiplication, 34-36 
z transform, 348 
Ion beams, 370 
Ionosphere, 493 

Irreversibility. See also Retrodiction 
autocorrelation function, 45 
heat conduction, 476 
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Jaeger, J. C., xviii, 484, 485 
Jakob, M., 475, 485 
Jaw, S-B, 367, 372 
Jenkins, G. M., 2 48 
Jha, A. K., 333 
Jinc function, ]\(irx)/2x, 422 
exercises, 73, 374, 376, 377, 378 
Hankel transform, 337, 338 
integrals, 73 
notation, xx 
pictorial, 585 
Jones, R. C, 190, 192 


Kaufman, H., 381, 398 
Kelvin, Lord, viii, 74, 148 
Kerr, F. H., 369, 371 
Khinchin, A., 187, 190 
Kirchoff, G. R„ 74, 93 
Kirchoff's laws, 479, 480 
Kniess, H., 22 
Kontorti, N., 370, 371 
Komer, T. W., 21 
Kraus, J. D., 422, 423 
Kretzmer, E. R., 501, 506 
Kronecker delta, 101 
Kronland-Martinet, R., 500, 506 


Lag window, 288 
Lagrange, J. L., 236, 595 
Lagrange interpolation, 253 
Lanczos, C., 141 
Landau, L., 160 
Laplace, P. S., 595 

Laplace integral, convergence, 382—383 
Laplace transform 
advantages, 381-382 
applications 
initial value, 392-396 
switching problems, 396-397 
transient response, 385-392 
convergence, 382 
and diffusion equation, 484 
examples, 388 

impulse response, 381, 390-392 
inversion, 349, 381 
and Mellin transform, 343-344 
natural behavior, 389-390 
notation, 7 

one-sided, 22, 380,401, 522 
pairs, 386-389 
p-multiplied, 381 
switching problems, 396 


Laplace transform (Cont.): 
table, 388 
theorems, 385 

and transient problems, 385-386, 392-396 
and z transform, 348-349 
Leakage, 246, 281 
Lenses, 368, 370 
Leon-Garcia, A., 428, 442, 469 
Lerch's theorem, 87 
Light, 66, 112, 308. See also Diffraction 
Lighthill, M. J., 21, 93, 96, 99, 128, 130 
Lightning, 370, 491 
Limit. See Transforms in the limit 
Linden, D. A., 233-234, 248 
Linear algebra, 38-39 
Linear filters, 39, 203-204 
time-invariant, 200, 209 
Linear transformation, 39, 213, 215 
Linearity, 367 

exercises, 212-213, 215, 530-532 
and space invariance, 213 
and stability, 214 

and time invariance, 209-211, 212-213 
LINPACK, 141 
Lipschitz condition, 9 
Location measurement, 155 
Lohmann, A. W., 370, 371, 505, 506 
Low-pass filter, 54, 65-68, 75, 224-226 
Lunar eclipse, 486 


McBride, A. C., 369, 371 
McCollum, P. A., 22, 381, 398 
McLachlan, N. W„ 22 
Maclaurin series, 78,134, 234, 528 
Magnetic focusing, 370 
Magnetosphere, 370, 493 
Mallat, S., 500, 506 
Mann, S., 503, 506 
Mapping, radio source, 471 
Marathay, A. S., 423 
Marine mammals, 493 
MATIIEMATICA, 141 
MATLAB, xx, 141-142, 272-275 
and DCT, 304 
and DFT, 272-275 
and DHT, 291-292, 323 
exercises, 536, 537 
reversal in, 291, 326 
and 365 data values, 284 
timing program segments, 283 
Matrix notation, 36-38, 275, 317 
Maxima, infinite number, 9,10 
Maxwell distribution, 590 
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Maxwell's equations, 92 
Mean frequency, 507 
Mean-square abscissa, 158-159,173 
square root of, 159 
Mean-square width, 171-172 
Measure 
location, 155 
of uration, 170-172 
Medical instruments, 148 
Meher, P. K., 299, 325 
Mellin transform, 343-347, 349 
table, 345 
theorems, 346 

Mendlovic, D., 370, 372, 505, 506 
Meteorology, 33,184-185, 228 
Meteors 

communication system, 444 
diffusion of trail, 475, 486 
trail distortion, 473 
Michelson, A. A., 416, 423 
Michelson interferometry, 307 
Microdensitometer, 351 
Microscopes, 1 

Microwave spectroheliograph, 402 
Microwaves, 308, 419, 486 
Midpoint interpolation, 225, 290 
Mihovilovic, D., 503, 506 
Mikusinski, J. G., 93, 99 
Millane, R. P., 300, 307, 325 
Minus-i transform, 6, 410 
Misfortunes, 436 
Mitchell, J. L., 304, 325 
Modified Abel transform, 352 
Modulation theorem 
and antennas, 414-415 
converse, 208, 209 
for Fourier transform, 113-115,130 
for Laplace transform, 385 
and rectangular pulse pair, 153 
for two-dimensional Fourier transform, 332 
for waveforms and spectra, 206, 207-208 
Moment 

addition property, 434 

and central-limit theorem, 190 

first, 153-155, 155-156 

given by Mellin transform, 344 

nth, 157-158, 206 

second, 157,189 

third, 444 

in two dimensions, 333 
Moon 

occultation, 425 
radiation from, 486 
Moran, J. M., 423 


The Fourier Transform and Its Applications 

Morlet, J., 500, 506 
Morse code, 138,153 
Mountain example, 330 
MRI image, 405 

MTF (Modulation transfer function), 416 
Multidimensional transforms, 340 
Multiplication, and convolution, 252 
Music, 194,195, 374 
G-string, 489 
Musical pitch, 374 


NAG, 142, 149 
Namias, V., 370, 372 
Natarajan, R., 304, 324, 372 
Natural behavior, 389-390 
Navigational devices, 148 
Near field, 420 
Networks 

electrical networks, 74-75, 391 
four-terminal, 200 
resistance-capacitance, 478-479 
Newcomb, R. W., 209n, 221 
Newton, Isaac, 147 
Noise, 446 

amplitude distribution, 450-451, 454, 463 

apectral component 

autocorrelation, 455-458, 470, 471 

bandpass, 464-466, 465 

coherence, 471-472 

detection, 466, 473 

envelope, 465-466 

filtering, 450-451, 462 

fluctuations, 446-447, 472 

Hilbert transform, 465-466 

low-pass, 561 

measurement, 466-468, 469 
random, 446, 471, 473-474 
Rayleigh distribution, 465-466 
records, 447, 462-465 
spectra, 458-461 
white, 171, 560 
zero crossing, 469-470, 473 
Nonreversibiity, 8, 45 
Normal distribution, 58 
in two dimensions, 59. See also Gaussian 
function 

Normalization, 41 

Notation, see also Asterisk; Pictorial represen¬ 
tation; Shah; Symbols 
circumflex, 63 

for complex functions, 68-70 

for diffusion, 479 

for Fourier transform, 7 
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Notation ( Cont.): 

for Fractional Fourier transform, 367 

frequency distribution, 428 

for Laplace transform, 7 

matrix, 36-38 

multidimensional, 89-92 

musical, 490 

pentagram, 40-45 

for rectangle function of unit height and 
base, 55-57 
for rectangle pulse, 2 
reversibility notation, 7-8 
for sequences in serial products, 39 
for serial product in matrix, 36-38 
special symbol summary, 70-71 
step-function, 62-65 
Stieltjes integral, 48 
systems 1, 2 and 3, 6-7,199 
for triangle function of unit height and 
area, 57-60 

Nuclear magnetic resonance (NMR), 356 
Null functions, 64-65, 87-88,101 
Numerical convolution, 32, 53 
Numerical filtering, 224-225, 462 
Numerical transformation, 305 
Abel, 353 

Fourier, 140-144, 272-275, 275-278 
Nussbaumer, H. J., 283-284, 289 


Occultation, lunar, 425 
Ocean, 194, 286-287 
Oceanography, xvii, 425 
Odd function, 11-14, 266 
Odd impulse pair, 70 
Olnejniczak, K. J., 211, 297, 308, 325 
O'Neill, O., 423 
On/off servomechanisms, 138 
Onural, L., 372, 505, 506 
Oppenheim, A. V., 211, 289 
Optical Fourier transform spectroscopy, 148 
Optical-image formation, 351 
Optics, 20, 368 
and antenna theory, 419 
and Wigner distribution, 505 
Ordinates 

and abscissa equal unity, 68 
sampling, 230-232, 249 
Oscillator, Hartley, 296-297 
Oscilloscopes, 75,147 
OTF (optical transfer function), 416 
Overshoot, 240-242, 250 
Ozaktas, H. M., 370, 371, 505, 506 


Packing theorem, 271, 290. See also Zero 
packing 

Paley, R. E. A. C., 21 
Panda, G., 325 

Papoulis, A., 22, 423, 428, 442, 447, 469 
Papyrus, 82 

Parabolic pulse, 146-147, 588 
Paraboloid reflector, 403, 424, 472 
Parseval's theorem, 252 
related theorems, 119-120, 271, 290 
in two dimensions, 332 
Particularly well-behaved functions, 94-96, 
127-128 

Parzen, E., 428, 442, 469 
PASCAL, 141,149, 323 
Pascal's pyramid, 50 
Pauly, John, 405 
Peak voltometer, 473 
Pearson Type III, 439, 440 
Pei, S-C, 323, 325, 367, 372 
Pennebaker, W., 304, 325 
Pentagram notation, 40, 46, 70 
Periodic barcode, 217 
Periodic functions 
convergence, 236-238 
and discreteness, 258-259 
exercise, 217 

as impulse trains, 245-246 
overshoot, 240-242, 250 
in pairs in the limit, 10-11, 75 
and similarity theorem, 109 
sum of, 211 

Periodic structures, 82-83 
Periodicity, 211, 236 
of impulse trains, 245-246 
Perkins, M. G., 300, 325 
Permittivity, 148 

Permutation, 276-278, 309, 321-323 
PERMUTE, 309 
Pettit, R. H„ 49, 52 
Phase angle (pha), 47 

Phasor generalization, by Hilbert transform, 
361 

Phasor representation, of Fourier integral, 20, 
423 

Photography, 281-282, 422 
Physical realizability, 363, 363n 
Pictorial Dictionary, xx, 2,142, 573 
Fourier integral transform pairs, 305 
integral cosine transform examples, 301 
Pictorial representation, 68-70 
Pierce, J. R., 370, 372, 493, 506 
Plancherel, M., 120 
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Plancherel's theorem. See Rayleigh's theorem 

Plasma devices, 479 

Plus-i Fourier transform, 6, 435 

Point charge, mass, 4, 74 

Point response function, 416 

Poisson, S. D., 74, 595 

Poisson distribution, 428, 434, 438, 441, 444 

Poisson's equation, 92 

Poker, heated, 478 

Polygonal functions, 57,145-147, 211-212 
Polynomials, 30, 348. See also Hermite poly¬ 
nomial pairs 
Power spectrum 
angular, 412 

and autocorrelation, 122,170 
definition, 285-286 
and DHT, 314 

and electromagnetic signal, 148 
of error component, 140 
of noise, 459, 466-468 
positive frequency, 180 
in slow Fourier transform program, 142 
smoothing, 287-288 
and spectrograph, 493 
and upcross and peak rates, 469-70 
of waveform, 143 
Power theorem, 120-122 

for generalized functions, 129 
for Hankel transform, 339 
for Hilbert transform, 363-364 
in two dimensions, 332 
Precision resistor, 443 
Prediction, 250 

Press, W. H., 22, 141, 249, 2 89, 302, 304, 321, 
325 

Pressure distribution, 89 
Pressure gauges, 425 
Price, K. M., 403 
Principal solution, 515 
Prisms, 112,147-148, 413 
Probability distribution, 428 
convolution of, 430, 433 
Fourier transform of, 435, 450-455 
of reciprocal, 444 
of sum, 329, 444 
Probability integral, 59 
Probability ordinate, 58-59 
Probable error, 59 
Product 

Fourier transform of, 117, 269 
of impulses, 103 
for Laplace transform, 385 
for Mellin transform, 346 
Product moment, 453, 455, 470 


The Fourier Transform and Its Applications 

Projection, 357-358 

Prolate spheroidal wavefunctions, 217 

Proofs, of theorems, 128-129 

Pseudocode, xix 

Pulse modulation, 82, 347 

Pulse sequence, 75-78, 590-593 

Pulse train, 248 


Quadratic content theorem, 301 
Quadrature function, 361 
Quadrupoles, 92 
Quasi-monochromatic pulse, 361 
Quatrefoil pattern, 92 
Quian, S., 506 


Rabiner, L. R., 2 89, 490, 506 
Radar 

and Abel transform, 351 
echoes from planets, 491 
frequency determination, 500 
pulse generator, 196 
raster scanning, 82 
spectral analysis, 147 
and uncertainty relation, 180 
Radar mapping, 351 
Radial sampling, 376 
Radiator, electromagnetic, 92 
Radio image, 404 
Radio interferometry, 45, 281 
Radio signal, 363 
Radio source, 403, 471 
Radio telescope, 403, 446, 447 
exercises, 424, 471 
Radio waves, 20 
Radioactive atom, 436 
Radioactive decay, 28 
Radioactive isotope decay, 28 
Radiofrequency spectral analysis, 147 
Radiometry and equivalent width, 165 
Radius of gyration, 159, 344 
Radon transform, 329, 356-358 
Railroads, 255 
Rainfall, 184-185, 438 
Ramo, S., 423 
Ramp function, 61-62, 211 
Ramp-step function, 55, 76-77, 584 
Random array, 473 
Random digits, 447 450 
Random input, 450 
Random noise, 45-46, 444, 446 
artificial, 447, 471 
and linear detector, 473-474 
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Random numbers, sum of, 450 
Random phenomena, 428, 437, 443-444 
Random polarization, 446-447 
Random process, 286 
Random walk, 60 

Rao, K. R., 283-284, 289, 302, 304, 324, 325, 
371 

Raster scanning, 426 
Ratcliffe, J. A., xviii 
Rayleigh, Lord, 119 ,130 
Rayleigh distribution, 428, 575 
definition, 59-60 
of detector output, 466 
exercise, 133 
of heat flow, 480 
of noise envelope, 465 
Rayleigh's theorem 
for Fourier transform, 119-120,130 
for Hankel transform, 339 
Parseval-Rayleigh theorem, 271 
and power theorem, 121-122 
in two dimensions, 332 
for waveform, 206 

Real transforms, 293-295, 301, 305-306 
Reciprocal sequences, 34, 348 
calculation, 35-36 
exercises, 51, 250 

Reciprocal transform, 5, 16, 266, 293, 301, 329 
rect x, l\(x), xx, 55, 57 
Rectangle function, 4 
defined, 55-57 
evenness, 80-81,101 
exercises, 53, 212, 216 
Fourier transform of, 105-107,137 
generator for, 212, 216 
Hilbert transform of, 365 
and impulse symbol, 75, 77, 83 
inverse operator, 528 
Laplace transform of, 388 
notation, 2 

and running means, 57 
and sampling, 224-226 
and segmentally built functions, 138 
sequences of, 77, 81, 83, 93 
and sine function, 105 
widths, 168, 468 
Rectified sinusoid, 585 
Reflection coefficient, 148 
Refractive index, 148, 368 
Regular sequence, 94-95 
Repeated root, 389 
Replacement rule, 274 
Replication, 81, 83-84, 91 
and sampling, 172-174, 221, 237 


Replication ( Cont .): 

of sine function, 552 
Resistance, negative, 215 
Resistance-capacitance networks, 478-479 
Resistor tolerances, 429-430, 443 
Resolution, finite, 93 
Resolving power, 4, 24, 74, 531 
Resonance, 78 
Resonators, 28 

Response, to point source, 4, 74 
Restoration, running mean, 194-195 
Retrodiction, 485 
Reversal property, 17, 268 
Reversal theorem, for Laplace transform, 385 
Reversibility 
of autocorrelation, 45 
and diffusion versus wave propagation, 
476-480 
notation, 6, 8 
Riddle, A. C., 357, 373 
Riemann integral, 236 
Ring impulse, 104, 338 
Ripley, B. D., 447, 469 
River current, 253 
Road example, 162-163 
Roberts, G. E., 381, 398, 416 
Root-mean-square value, 469 
Rotation theorem, 129, 332 
Row of spikes, 91-92 
Rule of thumb, 469 
Running mean 
exercises, 194-195 
and filtering, 226-229 
and rectangle function, 57 
of sunspot number, 191 
in transform domain, 184, 189 
in two dimensions, 333 
of waveform, 206 
for weekly data, 33 
Rims, 452 


Sampling. See also Undersampling 
critical, 223 

for data control, 82, 347 
interlaced, 232-234, 235, 250, 251 
intervals in, 219 

ordinate and slope, 230-232, 249 
in presence of noise, 234-235 
radial, 376 

and replication, 172-174 
shah, 81-82, 221-223, 236, 251 
slopes, 230-232, 249 
Sampling rate, 254 
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Sampling symbol, 70, 81-83 
Sampling theorem, 219, 222, 224 
inverse, 256 
Satapathy, J. K., 325 
Scanning, see Convolution 
Schafer, R. W., 211, 289, 490, 506 
Schelkunoff, S. A., 423 
Schrodinger's equation, 196-197, 370 
Schwartz, L., 93-94, 99 
Schwartz, M., 211 

Schwarz's inequality, 49, 176, 178, 189 
and uncertainty relation, 178 
Scrambling, 321 
Sea spectra, 286-287 
Sech pulse, 583 
Second difference, 184, 206 
Second moment, 156-157,189 
for Hankel transform, 339 
infinite, 157 

from Mellin transform, 344 
Second moment theorem 
in two dimensions, 333 
Segmented functions, 57, 145-147 
Seismograms, 491 
Self-convolution, 189, 438-439 
and autocorrelation, 40-41 
exercises, 51,191 
formulas, 119 
and Gaussian form, 187 
Gaussian tendency, 187 
and sampling, 249 
of sine function, 52 
Self-multiplication, 187 
Self-transforming functions, 23, 193 
Semicircular envelope, 591 
Semicircular pulse, 585 
Semiconductors, 475, 479 
Semi-infinite sequence, 32, 34 
Separable product theorem, 333 
Sequence 

of Gaussian functions, 60 
inverses of, 36, 37 
mean of, 271 

of particularly well-behaved functions, 
95-96 

of pulses, 75-78, 88, 93 
reciprocal, 34 

of rectangle functions, 77-78, 81, 83 
regular, 94-95 

representable by polynomial, 30-34, 347 

semi-infinite, 32, 34 

in serial products, 38-39 

sum of, 34, 270 

two-sided, 33 


Sequence {Cont.): 
as vectors, 38-39 

Serial division, 32, 348. See also Convolution 
asterisk notation, 32 
inversion of, 34-36 
in matrix notation, 36-38 
numerical calculation, 32 
problems, 49, 250 
sequences in, 38-39 
of signal samples, 250 
in statistics, 431-432 
SETI Institute, 147 
Seventh wave, 194 
Sgn, 22, 65, 71, 72 
Fourier transform of, 140, 420 
Shah function, xx, 577 
Shah symbol, xx, 3, 74-78, 414 
in Fourier series, 237 
Fourier transform, 246-248 
notation, 82n, 256 
replicating property, 82-84 
in sampling, 81-82, 221-222, 251 
sifting property, 82 
Shannon, C. E., 248 
Sharpening, 162-163, 174, 194-195 
Shear theorem, 129, 333, 374 
Sheng, Y., 500, 506 
Sheppard, C. J., 370, 372 
Shift theorem, 207 
and antennas, 412-413 
and discrete Fourier transform, 268-269 
for Fourier transform, 111-112,111-113, 
114, 129,130,131, 207, 268-269, 332 
for fractional Fourier transform, 369 
for Hankel transform, 339 
for Hilbert transform, 365 
for Laplace transform, 385 
proof, 129 

in two dimensions, 332 
and waveforms, 207 
Shockley, W., 476n 
Shuffling, 171,192, 321 
Si, 66-67, 241 
Sifting, 78-81, 86,102 
shah symbol, 82 

Sign function (sgn), 22, 65, 71, 72 
Fourier transform of, 140, 583 
Signal theory, 203 
Signal-to-noise ratio, 469 
Silver, S., 423 

Similarity theorem, 108-110 
for antennas, 411-412 
and DFT, 272 
and equivalent width, 167 
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Similarity theorem (Conf.): 
and FHT algorithm, 310 
for Fourier transform, 129-130 
for Hankel transform, 339 
for Laplace transform, 385 
proof, 129 

symmetrical version. 111 
in two dimensions, 332, 335 
for waveforms, 205-207 
Simple shear theorem, 333 
Sine function, 168 
and antennas, 415 
and central-limit theorem, 195 
as continued product, 195, 525 
derivatives, 73 
exercise, 216 

Fourier transform of, 105,107,138 

interpolation, 292 

Madaurin series, 528 

notation, xx 

pictorial, 578 

and power spectrum, 460 

replicated, 552 

and running mean, 185 

and sampling, 220, 224 

self-convolution, 52 

sine 2 , 66-68,105 

in slow Fourier transform example, 144 
and smoothness, 160 
spectral nature, 65-66 
table, 508-512 
Sine function 

central ordinate of transform, 153 
Hilbert transform, 360-361 
and impulse pairs, 84 
Sine integral, 65 
Sine transform, 17,150 
discrete, 301-304 
graphic representation, 18 
and Hankel's theorem, 340 
Sinusoid, 61, 183-184, 416 
Sinusoidal response, xx, 3, 39 
Sinusoidal time variation, 485 
Size distributions, 437-438 
Slopes 

sampling, 230-232, 249 
upper limits, 174-176 
Sloping step function, 55 
Slow Fourier transform, 136,142-144 
Smearing, 24 
Smith, Babington, 462 
Smoothness, 160-163, 476 
Sneddon, I. N., 21 

Software, for Fourier analysis, 141-142 


Soil temperature, 487, 488 
Sonine functions, 427 
Sound, underwater, 493 
Sound tracks, 3, 53, 162 
exercise, 212 

Space invariance, 3,115, 213 
Spacing, of impulses, 83 
Spatial frequency, 417 
Spatial sinusoid diffusion, 481-484 
Spedal symbols, 70, 71 
Spedfic heat, 476 
Spectral analysis, 142, 147-148 
Spectral lines, 48,164, 239, 287 
Spectral window, 288 
Spectrograph, dynamic, 491-494 
Spectroheliograph, 402 
Spectroscopy 
and equivalent width, 165 
Fourier transform, 287 
Spectrum. See also Angular spectrum; 
Dynamic power spectra 
angular, 409-417, 417-419 
cutoff, 66-67 
energy, 47-48 

frequency increase effect, 163-164,174 
and function width, 167 
Hermitian, 199 
line to continuous, 239 
measurement of, 147-148 
of noise waveform, 458, 461 
random input effect, 458-462 
resolution exercise, 218 
and sharpness, 174 
and waveforms, 1,198-200, 206 
of X radiation, 48 
Speech, 490, 491, 492-493 
Spline interpolation, 252-253 
Square, equation of, 537 
Stability, 214, 215 
Staircase function, 138, 400 
Standard deviations, 43, 59 
Statics, 155, 428-445 
mean-square abscissa, 158 
Statistics. See also Random numbers 
for frequency distribution 
and convolution, 430-435 
distribution of a sum, 429-433 
notation, 429 

probability density, 438-442 
truncated exponential distribution, 
436-438 

Gaussian distribution in, 59 
Stegun, I. A., 190, 195 
Steiner, Jacob, 192-193 
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Steiner symmetrization, 192-193 
Step function, 61-65, 70 
Step response, 201-202 
Steward, E. G., 469 
Stieltjes integral, 4, 5, 48 
Stirling formula, 441 
Stock market problem, 378 
Stored energy, 392 
Strang, G., 500, 506 
Streibl, N., 370 
Strength, absolute, 287 
Stress deflection, 115 
Stretching, 272, 276 

Strip of convergence, 382-383, 384, 385 
exercises, 398, 400 
Stripe diagram, 315 
Stutzman, W. L., 423 
Subband coding, 502 
Subsidiary equation, 386 
Sum 

distribution of, 429-433 
of series, 34 
Summary 
of symbols, 70, 71 
of theorems, 130 
Sunspots, 191, 254, 366 
Superposition, 24, 209, 391-392 
Surfing, 194 
Sutton, G. A., 308, 325 
Swartztrauber, P. N., 370, 371 
Swarup, G., 402, 469 
Swenson, G. W., Jr., 423 
Switching problems, 396-397 
Switching waveforms, 145-146 
Symbols, 2-3. See also Notation 
bed of nails, 90 
definition, 74n 

for generalized functions, 96-98 
impulse, 4 

sampling (replicating), 70, 81-83 
summary of special, 70, 71 
for transformation, 7-8 
Symmetrization, 193 
Symmetry, 11-14, 267 
exercises, 22-23, 51 
System function, 200 
Systems, 1, 6-7, 199 


Tables 

Abel transform, 354 
Fourier transform, 21-22, 105 
Gaussian function, 508 
Hankel transform, 338 


Tables (Cont.): 

Hilbert transform, 365 
Laplace transform, 388 
Mellin transform, 345 
of sequences and inverses, 37 
sine x, sine 2 *, exp (— ttx 2 ), 508-512 
special symbols, 70-71 
three-dimensional Fourier transform, 342 
two-dimensional Fourier transform, 
334-335 

z transform, 350, 351 
Tabular intervals, 82, 91, 140 
Tabulation, 2 

Tangent, hyperbolic, 539, 584 
Tanh, Fourier transform of, 584 
Tape recorders, 3 
Tapering factor, 288, 291 
Telescopes. See also Radio telescope 
antenna analogy, 419-420 
Television camera, 351 
Temperature 

sinusoidal, 481, 485, 486, 487 
subsurface, 488 

Temperature, sinusoidal, 487-488 
Temple, G , 74n, 93-94, 99 
Teukolsky, S. A., 21, 141, 149, 289, 302, 304, 
321, 325 
Theorems 

Fourier transform, 130 
Hankel transform, 339 
Hartley transform, 298, 300-301, 310, 
375-376 

for Hilbert transform, 372 
Laplace transform, 385 
Mellin transform, 346 
transform generation by, 145-147 
for two-dimensional Fourier transform, 
332-335 

for waveforms spectra, 206 
for z transform, 351 
Thermal radiation, 486 
Thermal units, 476 
Thermo-electric analogy, 487, 541 
Thompson, A. R., 403, 423 
Three dimensional Fourier transform, 
340-343, 375, 378 
He and toe, 283 
Time 

and autocorrelation, 45-46 
in heat conduction, 476-480 
and similarity theorem, 109 
and spectral resolution, 489-490, 502 
Time domain, and frequency domain, 

195 
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Time invariance, 39 

and linearity, 209-222, 212-213 
versus space invariance, 3 
in switching problems, 396-397 
Timing, 282-283, 292, 314-317 
diagram, 316 

Titchmarsh, E. C., 21,120 ,130 
Tolerance, 429-430, 443 
Tomography, 356-358, 405 
Trains, 255 

Transducers, see Filters 
Transfer factor, 200, 203, 209 
Transfer function, 200, 209, 390, 416 
Transform pairs in the limit, 75,139 
Transforms in the limit 
definition, 10-11 
and Gaussian functions, 60 
reciprocal real, 293-295 
of sine function, 105 
squared modulus, 47-48 
Transient response, 385-386 
Translation, 152 
Transmission lines, 545 
and Abel transform, 351 
exercises, 212, 215, 401, 488 
heat diffusion, 475-479 
and sinusoidal time variation, 485 
Trapezoidal, 145, 429-430 
Triangle function, 57,105,168, 264 
exercises, 73 

Fourier transform of, 105, 107 
Triangular aperture, 426 
Triple correlation, 45, 46 
Truncated exponential, 384, 388, 581 
convolution, 27-28 
and noise waveform detection, 466 
in statistics, 436-438 
Tukey, J. W., 141, 149, 248, 275, 2 88, 289 
Tuning capacitors, 147 
Two-dimensional autocorrelation, 53, 291, 
376 

Two-dimensional convolution, 53, 290, 331 
Two-d im ensional Fourier transform, 284, 
332-335 

exercises, 374, 375, 377 
theorems, 332 

Two-dimensional Hartley transform, 
299-300 

Two-dimensional theory 
antennas, 417-419 
Two-port element, 200 
Two-sided sequences, 33 


Uffirtk, J., 190 
Uncertainty principle, 490 
Uncertainty relation, 172, 177-180, 189 
Undersampling, 229-230, 249 
Underwater sound, 493 
Unit step function 
and cyclic convolution, 265 
and impulse symbol, 75-78 
symbol, 70 
uses of, 61-65 
Unity, 68 

Upcross, 469-470, 473 
Upcross rate, 469, 473 
Update operator, 252 


Van der Merwe, A., 190 

van der Pol, B., 22, 74, 93, 99, 381, 398, 

484, 485 

Van Duzer, T., 423 
Variance, 159-160 

additive under convolution, 189, 430-431, 
434 

of Gaussian function, 188 
Vectors, 38-39 
Velocity/force, 203 
Vetterli, M., 501, 506 

Vetterling, W. T., 21,141, 149, 2 89, 302, 304, 
321, 325 

Villasenor, J. V., 300, 307, 323, 325 

Violin, 194, 302-303 

VLA (Very Large Array), 404 

Voelker, D., 22 

Voice print, 492 

Voigt profile, 135 

Volcano, 135 

Voltage, 61, 185, 397 

Volterra, V., 25 

Voltmeter, 473 


Walker, J. S., 21, 289, 323, 325 
Wang, S., 372 
Wang, Y.-H., 333 
Wang, Z., xix, 325 
Water waves, 135, 425 
Watts, D. G., 248 
Wave equations, 92, 476 
Waveforms, 1 
acoustical, 47 

analogy with antennas, 410-411 
choice of origin, 143 
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Waveforms (Co«f.): 
detection of noise, 466 
and Laplace transform, 389 
ocean, 194. See also Sea spectra 
periodicity of, 211 
random, 447-450 
and sampling theorem, 220 
and shift theorem, 412 
and spectra, 1,198-200, 206 
switching, 145-147 
Wavelet, 501, 506, 507 
Wavepacket, 172,194, 502, 586 
Weather data, 184-185 
Weekly summing, 150 
Weigelt, G., 46, 49 
Whinnery, J. R., 423 
Whistlers, 491 
Whistles, 502, 507 
White noise, 171 

Width. See also Autocorrelation width; 

Equivalent width 
to half power, 167 
Wiener, N., 21, 130, 190, 248 
Wiener's theorem, 122n 
Wigner distribution, 370, 504-505, 507 
Wild, J. W., 425 
Wild's array, 425 
Window, spectral, 288 
Window function, 57 
Winograd, S., 284 
Wolf, E., 422 


Woodward, R M., xx, 66, 71 
Wu, J-L, 323, 325 


X-rays 

and autocorrelation, 45 
diffraction, 340, 375 
exercises, 374, 424 
and FFT, 281 

spectra from molybdenum, 48 


Yagi antenna, 407 
Yang, D., 299, 325 
Yang, K. S., 402 
Yarbrough, J., 491, 492 
Yariv, A., 423 
Yip, P., 2 89, 302, 304, 325 
Young, Thomas, 595 


z transform, 347, 350, 374 
Zalevsky, Z., 370, 371 
Zero 

area of function, 172 
and central-limit theorem, 191 
replacement rule for indices, 274 
Zero crossing, 469-470, 473 
Zero packing, 275 
Zero slope at the origin, 155 




Special symbols 


Function 

Notation 

Rectangle 

noo . {' M<! 

( ’ to M > S 

Triangle 

AM = I 1 - 1x1 1x1 < 1 

^ } \0 W > 1 

Heaviside unit step 

HW-j* I>0 

le x < 0 

Sign (signum) 

/l x > 0 

SgnX = \-l x < 0 

Impulse symbol 

6(x) 

Sampling or replicating symbol 

ni(x) = 2 8(x - h) 

—o i 

Even impulse pair 

n(x) = \6(x + £) + j8(x - l) 

Odd impulse pair 

\M = 2^H X + 2 ) — 2^(* j) 

Filtering or interpolating 

sin 7rx h(vr) 

sincx --, line r = —— 

ttx 1 2r 

Asterisk notation for convolution 

/(x) * g(r) A [ f(u)g(r - u)du 

Asterisk notation for serial products 

{/,}•<*} A {XM-i} 

Pentagram notation 

( CXJ 

f(x) * g(x) 4 f(u)g(x + u)du 

Various two-dimensional functions 

2 n(x,y) = n(x)n(y) 

2 8(x,i/) = S(x) %) 

2 III(x,y) = III(x)III(y) 

2 sinc(x,y) = sincx sine y 

Guide to reference data 

Summary of special symbols 

70, 71 

Oddness and evenness 

13, 15 

Conjugates 

16 

Fourier transforms 

107,131, 265, 573 

Theorems for Fourier transform 

130, 206, 268 

Correspondences in the two domains 

190, 199 

Laplace transforms 

385,388 

Two-dimensional Fourier transforms 

333-335 

Three-dimensional Fourier transforms 

342 

Hankel transforms 

338 

Mellin transforms 

345-346 

z transforms 

350-351 

Abel transforms 

354 

Hilbert transforms 

365 









